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We construct a framework for the study of fluctuations in the nonequilibrium relaxation of glassy 
systems with and without quenched disorder. We study two types of two-time local correlators with 
the aim of characterizing the heterogeneous evolution in these systems: in one case we average the 
local correlators over histories of the thermal noise, in the other case we simply coarse-grain the local 
correlators obtained for a given noise realization. We explain why the noise- averaged correlators 
describe the fingerprint of quenched disorder when it exists, while the coarse-grained correlators are 
linked to noise-induced mesoscopic fluctuations. We predict constraints on the distribution of the 
fluctuations of the coarse-grained quantities. In particular, we show that locally defined correlations 
and responses are connected by a generalized local out-of-equilibrium fluctuation-dissipation relation. 
We argue that large-size heterogeneities in the age of the system survive in the long-time limit. 
A symmetry of the underlying theory, namely invariance under reparametrizations of the time 
coordinates, underlies these results. We establish a connection between the probabilities of spatial 
distributions of local coarse-grained quantities and the theory of dynamic random manifolds. We 
define, and discuss the behavior of, a two-time dependent correlation length from the spatial decay 
of the fluctuations in the two-time local functions. We characterize the fluctuations in the system 
in terms of their fractal properties. For concreteness, we present numerical tests performed on 
disordered spin models in finite and infinite dimensions. Finally, we explain how these ideas can 
be applied to the analysis of the dynamics of other glassy systems that can be either spin models 
without disorder or atomic and molecular glassy systems. 



PACS: 75.10.Nr, 75.10.Jm, 75.10.Hk, 05.30.-d 
I. INTRODUCTION 

A mean-field theory of glasses has been developed dur- 
ing the last two decades [1-3] . This approach is based on 
the study of fully-connected spin models with disorder. 
A fully-connected spin system with pairwise interactions, 
the Sherrington-Kirkpatrick (sk) model, is used to model 
spin-glasses [4-7] . Extensions in which the spins interact 
via all possible p-uplets, with p > 3, are used to describe 
structural glasses of fragile type [8,9]. These are the so- 
called p-spin models. Even though structural glasses con- 
sist of molecules moving in a finite dimensional volume, 
rather than spins interacting via random exchanges on 
a complete (hyper) graph, the disordered p-spin models 
yield a gross description of many important features of 
the structural glass phenomenology. For instance, they 
have dynamic and static transitions occurring at differ- 
ent values of the external temperature, mimicking the 
dynamic slowing down at the freezing temperature, T g , 
and the entropy crisis at the Kauzmann temperature, 
T s [8]. More strikingly, these models capture the slow 
non-equilibrium dynamics characterized by macroscopic 
observables showing aging effects below T g [7,9]. 



Whilst they are successful in many respects, these 
models lack a geometric structure and hence cannot in- 
form us about the spatial evolution of the glass former. 
In the context of spin-glasses, there is consensus about 
there being some kind of growing order below T g . How- 
ever, there has been a long-lasting debate about the char- 
acteristics of this order [10-20]. In other words, the ques- 
tion as to whether there are only two or many competing 
ground states, not related by symmetry, that grow dur- 
ing the nonequilibrium evolution [12,20-24] has not been 
answered yet. In comparison, it is not even clear if there 
is a phase transition in structural glasses [25]. 

Very recently, a number of experiments have shown 
the appearance of mesoscopic regions in supercooled liq- 
uids and glasses that have distinctively different dynam- 
ics from the bulk of the system [26-30]. The position 
and identity of these "particles" changes in time. In 
general, these regions are referred to as dynamic het- 
erogeneities and have also been identified in numerical 
simulations [31,32]. 

Developing a theoretical description of the real-space 
dynamics of glassy systems is now a major challenge to 
theoreticians. The purpose of this paper is to expand on 
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the theoretical framework we presented in Refs. [33,34] 
that allowed us to predict several properties of local dy- 
namic fluctuations in spin-glasses. We test the predic- 
tions of our framework against numerical simulations on 
a spin model with disorder defined on a finite dimensional 
lattice, the Edwards- Anderson (ea) model [4,5]. Follow- 
ing the philosophy described in the first paragraph, we 
claim that the main results arising from our analysis will 
carry on rather simply to the particle models which are 
more relevant for real glasses. In the Conclusions and 
Perspectives sections we explain how one should trans- 
late our results and predictions to this case. We also list 
a number of glassy models on which our ideas could be 
tested. 

A. Background 

We first briefly summarize previous studies (mostly ex- 
perimental and numerical) of dynamic heterogeneities in 
particle and spin systems that set the scene for our anal- 
ysis. 

There is great interest in the experimental observation 
of dynamic heterogeneous regions in super-cooled liquids 
and glasses. Many experimental techniques have been 
used to signal the existence of dynamically heterogeneous 
regions in samples of a variety of glasses [26-30], and to 
try to characterize their properties. The confocal mi- 
croscopy technique [28,29] is particularly useful for this, 
as it allows one to reconstruct the particle trajectories 
in 3d space and have the complete configuration of the 
system at chosen times. 

In the context of theoretical studies of structural and 
polymeric glasses, Benncmann et al. and Kob et al. 
identified fast moving particles embedded in a bulk of 
slow moving ones at temperatures above T g in the super- 
cooled liquid phase of several models using molecular dy- 
namics [31]. Other numerical studies of similar features 
appeared in [32]. 

In these experimental systems, and the models used to 
study them numerically, there is no quenched disorder. 
Moreover, the particles are identical and move in contin- 
uous space, so they cannot be identified by their position 
on a lattice, as in typical spin models. However, two 
possible ways of studying the heterogeneous dynamics of 
the system are as follows, (i) One can tag each particle, 
follow their evolution and detect which are the fast and 
slow moving particles during a previously chosen time- 
window around some time after preparation. Particles 
are labeled by an index i. This is the route followed in 
Refs. [31,32]. (ii) One can divide the space into boxes of a 
chosen size and study the behavior of all particles within 
each box. The locality is then given by the position of 
the box which is labeled by i. At the end of this article 
we explain why we believe that the second approach will 
be very useful to characterize some spatial features of the 



nonequilibrium dynamics of glassy systems. An analysis 
of data obtained with the confocal microscopy technique 
of real systems and molecular dynamics of simple models 
along the lines described in this paper will yield valuable 
information for the future development of a complete an- 
alytic theory for glasses. 

In the context of disordered spin models, fast and slow 
spins that decorrelate on totally different time-scales were 
identified in numerical simulations in Refs. [35] and [36] 
for the 3d EA model above and below T c , respectively. 
Ricci-Tersenghi and Zecchina [37] and Montanari and 
Ricci-Tcrscnghi [38] found a similar separation in the low 
temperature phase of spin models defined on random 
graphs. Even finite-size samples of mean-field models 
show important spin-to-spin fluctuations in the charac- 
teristic time-scale for individual decorrelation, as shown 
by Brangian and Kob for the disordered Potts model 
above its dynamic critical temperature [39]. A similar 
behavior, superposed on aging phenomena, is observed 
in the Sherrington-Kirkpatrick model at low tempera- 
tures, as shown in Sec. VIII B. In all these studies the 
noise-averaged correlations for fixed disorder were the fo- 
cus of the studies. In this type of analysis the identity of 
a spin is determined by its position on the lattice or by 
the random exchanges. 

In Refs. [33] and [34] we concentrated instead on the 3d 
EA model and its two-time coarse-grained (but not noise- 
averaged) local quantities. In Ref. [33] we showed that 
the action for the slow part of the local relaxation be- 
comes reparametrization invariant asymptotically. This 
(approximate) symmetry allowed us to propose several 
properties of the dynamic behavior of the coarse-grained 
local correlations and responses that we tested numeri- 
cally in Ref. [34]. These quantities are relevant both for 
spin models (with and without quenched disorder) and 
for continuous systems of interacting particles. 

B. Plan of the paper 

In this paper we complete the analysis that we started 
in Refs. [33] and [34]. We study several aspects of the 
local dynamics of the 2d and 3d EA spin-glass, 

Kj = J io s i s 3 ■ (!) 

The sum runs over nearest neighbor sites i,j on a d di- 
mensional cubic lattice. The couplings Jij take values 
±J/V2z with probability 1/2. z is the coordination of 
the lattice, z = 2d in the square/cubic case. The spins 
are Ising variables, Sj = ±1. 

We also analyze the dynamic fluctuations in finite di- 
mensional and fully-connected models with finite size. To 
test the latter we use the SK mean-field spin-glass model 
defined by 
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Hj = ^2j ij s i s j , (2) 

with Jij taken from a bimodal probability distribution 
with zero mean and variance [Jfj] = J 2 /(2N). (We ex- 
pect to find similar results using a Gaussian distribution 
of exchanges.) Here and in what follows we use square 
brackets to denote the average over disorder. 

We fix the value of J in such a way that the criti- 
cal temperatures are at T c ~ 1.1 for the 3d EA model 
and at T c = 1 for the SK model. The 2d EA model has 
a zero-temperature phase transition. We set the Boltz- 
mann constant, ks, to one. 

We focus on two types of locally defined correlations 
and susceptibilities: 

(i) coarse-grained local quantities C^ 9 (t 7 t w ) and 

x?(t,t w ). 

(ii) noise- averaged local quantities C™ a (t,t w ) and 
X?° (*,*»)■ 

The two time dependence reflects the out-of-equilibrium 
dynamics of these systems after the quench at time t = 0. 
t w denotes the waiting-time elapsed after preparation and 
t a longer time, t>t w . We present a detailed comparison 
of the behavior of these local non-equilibrium correlations 
that have been averaged differently. 

The numerical simulations were performed as follows. 
To study the finite d EA model we evolved a cubic 
(square) system with side-length L and periodic bound- 
ary conditions from a random initial condition using 
Metropolis dynamics at temperature T. The random ini- 
tial configuration represents the result of an infinitely 
rapid quench from infinite temperature performed at 
t = 0. In the 3d case we considered L = 32 and L = 64 
and for d = 2 we considered L = 128. To compute 
spatially coarse-grained two-time quantities we used a 
coarse-graining volume which is a cubic (square) box of 
linear size 2M+ 1. A coarse-graining time that serves to 
make the spin variable smooth varies from study to study 
and is noted in each plot. We considered several values 
of the external temperature that lie above and below T c 
and these are indicated as necessary. The noise-averaged 
data we present were obtained using shorter values of the 
waiting-time to allow for an average over many noise- 
realizations, typically 10 3 samples. 

When studying the SK model we evolved systems with 
N = 128 and N = 512 spins with Monte Carlo dynamics 
at T = 0.4 also starting from a random configuration 
of spins. The noise-averaged data were obtained using, 
approximately, 10 3 samples. 

In short, the results in this paper are organized as fol- 
lows: 

First, we establish the dynamic scaling forms of both 
coarse-grained and noise-averaged local quantities nu- 
merically. In particular, we test scaling forms that we 
propose in Sec. II. 



Second, we study the local relations between noise- 
averaged correlation and integrated response and be- 
tween the same quantities when coarse-grained. 

Third, we show that the global quantities in finite size 
systems in finite dimensions and those defined on the 
complete graph show similar fluctuations as the local 
quantities in finite d models. 

Fourth, we propose a relation between the study of 
the probability distribution of local fluctuations and the 
theory of dynamic random surfaces. 

Fifth, we define and analyze a dynamic correlation 
length that depends on two-times. 

Sixth, we present a new way of looking at geometric 
properties in spin-glasses that should be relevant to fu- 
ture experiments with local probes. We analyze the real- 
space organization of local correlations, C^ 9 and C" a by 
investigating the geometric properties of the (random) 
surfaces given by their evaluation on the substrate d di- 
mensional real space. In particular, we study the prop- 
erties of clusters of spins with local correlation in the 
interval [C, C + dC] for which C is a parameter taking val- 
ues between —1 and 1. Again we compare the behavior of 
noise-averaged and coarse-grained quantities. A similar 
analysis could be applied to the random surface of local 
susceptibilities, x? an d X? a - 

Because real systems do not equilibrate on accessible 
time-scales, spatially resolved measurements will not be 
static; instead, they will still depend on the age of the sys- 
tem, very much like the bulk or global measurements. In 
these measurements one can monitor noise and response 
in a mesoscopic region of the sample. The results of our 
analysis will be of relevance to the interpretation and 
analysis of these experiments. They can also be used as 
a source of inspiration to analyze dynamic heterogeneities 
in super-cooled liquids and glasses [27,31,32], as we dis- 
cuss in the Conclusions and Perspectives sections. 

C. Summary of results 

Before getting into the technical details, let us summa- 
rize our results. 

In Rcf. [33] we showed that, in the limit of long-times, a 
zero mode develops in the dynamics of finite dimensional 
spin-glasses. This soft mode is related to the invariance 
of the effective action for the slow fields (that are actually 
two-time functions) under a global reparametrization of 
time. Thus, we argued that the least costly spatial fluc- 
tuations should be ones that smoothly change the local 
time reparametrization. In Rcf. [34] we tested these ideas 
numerically by evaluating the local coarse-grained cor- 
relations and integrated responses in the 3d EA model. 
We observed that the fluctuations in these quantities are 
constrained to follow the fluctuation-dissipation relation 
(fdr) between the global quantities as a direct conse- 
quence of the existence of the asymptotic zero mode. 
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In this paper we show further evidence that the coarse- 
grained two-time correlators reflect the existence of an 
asymptotic zero mode in the underlying theory. In partic- 
ular, using the fact that the dynamics become "critical" 
in a well-chosen long time limit, we explain why a scal- 
ing limit of long-times and large coarse-graining volumes 
should exist in which the distributions of fluctuations ap- 
proach a stable limit. 

In disordered systems such as the 3d EA model, another 
set of local two-time quantities can be defined using a dif- 
ferent averaging procedure. Indeed, one can work with 
noise-averaged, as opposed to coarse-grained, two-time 
functions. Even if these quantities do not fluctuate in sys- 
tems without quenched disorder, they do in spin-glasses 
and other random systems due to the fingerprint of dis- 
order. One can then wonder if these quantities are also 
coupled to the asymptotic zero mode and whether their 
fluctuations are constrained in the same way as those of 
the coarse-grained quantities. We show numerically that 
this is not the case: the noise-averaged fluctuations be- 
have in a rather different way. 

In order to sustain further this claim, we also study 
the mesoscopic fluctuations in disordered models in finite 
and infinite dimensions. We show that the fluctuations 
in the global quantities, that are due to the finite size 
of the systems, behave just like the coarse-grained local 
quantities in finite dimensional models. We observed this 
property in the 3d EA and the SK model. 

We relate the study of the fluctuations in the local cor- 
relations (and susceptibilities) to the study of the evolu- 
tion of random surfaces. Indeed, we propose that one 
can derive a "phenomenological" effective action for the 
fluctuations in the local quantities from the statistical 
analysis of the surfaces given by the evaluation of the 
two-time quantities on the d dimensional substrate. This 
idea gives us a handle to describe analytically the fluctu- 
ations in a large variety of systems with slow dynamics. 

We study numerically the random surfaces describing 
the fluctuations in space of both the coarse-grained and 
noise-averaged two-time local correlators. We show that 
noise-averaging leads to surfaces that encode the finger- 
print of the disorder realization, and are static if the two 
times t and t w have a fixed ratio (or h(t)/h(t w ), with a 
more suitable function h(t), is kept fixed). 

The coarse-grained surfaces obtained for different pairs 
of times (t,t w ), even if the ratio t/t w [or h(t)/h(t w )\ is 
fixed, fluctuate and cross each other at many points as 
a function of t w . This result implies, as we show, that 
the relative age (as measured using the correlation value) 
between two sites i and j in the sample is not static, but 
fluctuates as a function of time. These are examples of 
sorpassi that we define in this paper, and show a clear 
contrast to noise-averaged local quantities, where the rel- 
ative age between all sites in the sample keeps a constant, 
static, relative rank. 

We define a two-time dependent correlation length 



£(t, t w ) using the spatial correlation of the local two-time 
correlations. We study how this correlation length di- 
verges asymptotically in the glassy phase of the 3d EA 
model. We discuss how the ratio between the coarse- 
grained volume and the correlation length affects the 
probability distributions for the measured quantities. In 
particular, we argue that when the coarse-graining length 
is smaller than the correlation length, one probes the spa- 
tial fluctuations controlled by the zero mode. When using 
coarse-graining lengths that are larger, but still of the or- 
der of the correlation length one is measuring mesoscopic 
fluctuations of nearly independent finite size systems. If 
the coarse-graining length is much larger than the corre- 
lation length the fluctuations are suppressed. We show 
numerically that the qualitative features of the local and 
mesoscopic fluctuations are indeed very similar and we 
conjecture that they may have a similar origin. 

Finally, we study the spatial organization of the lo- 
cal correlations (coarse-grained and noise-averaged). We 
propose that the analysis of the geometric properties of 
clusters of sites with similar values of the local two-time 
correlations can be useful to determine if one is at or 
below the lower critical dimension. More precisely, we 
claim that the geometric organization of the fluctuations 
in the 2d EA model are different from those in the 3d case 
signaling the fact that the former does not have a finite 
T transition. The difference is very clear when one looks 
at the fractal dimension of clusters, df. In 3 dimensions 
df ~ 2, whilst in 2 dimensions, df < 2. These values of 
the fractal dimension are quite close to each other - how- 
ever, the difference between the fractal dimension and 
that of the substrate space, A = d — df, is very different. 
In 3 dimensions, A ~ 1 and in 2 dimensions A <C 1. This 
suggests that the level surfaces in 2 dimensions lie on a 
much rougher underlying manifold, as we suggest from 
theoretical arguments in Sec. HID, and should be linked 
to the absence of a glass transition in d = 2. However, 
a multifractal analysis gives less clear-cut distinctions, 
suggesting that the non-equilibrium aging regime in the 
2 dimensional case has aspects that are very similar to 
the 3 dimensional case. 

In the conclusions we discuss how to adapt this ap- 
proach and the picture that emerges to super-cooled liq- 
uids and structural glasses. 

II. DEFINITIONS AND DISCUSSION 

In this section we define the two-time, global and local, 
correlators that we study numerically in the rest of the 
paper. We recall some known properties of the global 
correlators. We then discuss possible scaling forms for 
the local quantities, as well as the implications of these 
scaling forms. 
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A. Two-time dependent global functions 

To date, analytical, numerical, and experimental stud- 
ies in glassy systems have mainly focused on the global 
correlation and integrated response: 



1 N 

c(t,t w ) = — y^si(t)sj(t w ) 



1=1 

N 



A — 1 J t q 



dt 



, Ssi(t)ei 



(3) 
(4) 



?7=0 



where r\i is a (site-dependent) magnetic field given by 
i]i = r]€i with £i = ±1 with probability \ and 77 its mag- 
nitude. The field couples linearly to the spin, Hj — > 
Hj — J2i s iVi- The product Si(t)ei is the "staggered local 
spin", i.e. the projection of Si on the direction of the 
local external field In order to extract the linear part 
of the response the variation is evaluated at zero field, 
77 = 0. The integrated response is usually averaged over 
many realizations of the random field. 

For an infinite system that evolves out of equilibrium 
these quantities are self-averaging, and thus averages over 
the thermal noise and disorder (if existent) arc not re- 
quired. All the generic analytic arguments we shall de- 
velop assume that the thermodynamic limit, N — > 00, 
has been taken at the outset. (We discuss finite size ef- 
fects in Sec. VIII.) 



B. Two-time dependent local functions 

Quenched random interactions have a strong effect on 
the local properties of spin systems. For instance, Grif- 
fiths singularities in the free-energy of random fcrromag- 
nets are due to regions in space with strong ferromagnetic 
couplings [40] . These lead to dynamic slowing down even 
in the disordered phase of the random problem, below 
the transition temperature of the pure model. It is natu- 
ral to expect that heterogeneous dynamics in spin-glasses 
arises for similar reasons. In these systems random ex- 
changes can be very different between one region of the 
sample and another: some regions can have purely ferro- 
magnetic interactions, others can have purely antiferro- 
magnetic ones, others can be frustrated. One can analyze 
the fingerprint of the disorder on the local dynamics by 
choosing not to average over the random exchanges. 

However, heterogeneous dynamics do not arise sim- 
ply because of quenched random couplings. Glassy sys- 
tems with no explicit quenched disorder also exist in na- 
ture [25]. Many models with spin or particle variables 
that capture their behavior have been proposed [41-43]. 
Even if there is no quenched disorder in these systems, 
one expects to find heterogeneous dynamics in which 
some regions evolve differently than others [30,43]. 



An extreme example of the latter situation occurs in 
ferromagnetic domain growth [44]. At any finite time 
with respect to the size of the system, a coarsening sys- 
tem is heterogeneous. Observed on a very short time- 
window, spins on interfaces behave very differently from 
spins in the bulk of domains. However, there is nothing 
special about the identity of these spins. Spins that be- 
long to an interface at one time can later become part of 
a domain and even later be part of another wall. Impor- 
tantly, no local region (not even of the minimum linear 
size given by the lattice spacing) can be considered to be 
equilibrated while coarsening is taking place. 

If one wishes to analyze the local fluctuations in the 
dynamics of spin systems, two natural functions to mon- 
itor are the two-time local correlations and responses. 
These can be made continuous (in Ising spin systems) 
through different averaging procedures that highlight dif- 
ferent properties of the systems. Each definition has a 
different theoretical motivation. 

First, consider spatially coarse-grained functions [34] 



x?{t,t w )=- 



1 



V ^ 

jeVi 



dt' 



5sj(t)ej 



<%(*') 



(5) 



(6) 



?7=0 



where Vi is a coarse-graining region centered on site i with 
volume V, and the overline stands for a coarse-graining 
over a short time- window r t (r tra ) around t (t w ), r t <C t 
( T t w ^ tw)- (Note that we use the same coarse-graining 
volume on all sites.) Only one realization of the thermal 
noise is used here, which mimics nature. This definition 
is natural for the study of finite dimensional models in 
which there is a notion of space and neighborhood. In- 
deed, a coarse-graining procedure of this type is usually 
used to derive a continuum field-theoretical description of 
a problem originally defined on a lattice [45] . Moreover, 
it is of use if one wants to compare the behavior of finite 
dimensional models with and without disorder since it 
is non-trivial in both cases. This quantity is also rele- 
vant to compare with experiments in which mesoscopic 
probes are limited to testing the behavior of regions with 
a minimum size that involve a large (though mesoscopic) 
number of spins. 

Second, one can define single-site noise-averaged func- 
tions [35-39,46]: 



C? 



x? a (t,t w ) 



{t,t w ) = (Si(t)Si(t w )) , 

* ,., mm) 



(7) 
(8) 



r/=0 



Here and in what follows the angular brackets represent 
the average over thermal histories. These functions will 
appear, for example, in a dynamic cavity method applied 
to a disordered model [47] . This definition is particularly 
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useful for mean-field (fully-connected and dilute) systems 
with quenched disorder for which there is no notion of 
neighborhood. However, it completely erases the inher- 
ent heterogeneity of the dynamics in a non-disordered 
system such as ferromagnetic domain growth. More- 
over, a single-spin experimental measurement is unlikely, 
and usually a region involving a large number of spins is 
probed, implying an effective coarse-graining. 

Neither of the two definitions above include, in the case 
of random systems, an average over disorder realizations. 
This may allow us to detect regions that have special 
behavior due to the random interactions. We insist on 
the fact that the coarse-grained definition still contains 
noise-induced fluctuations. 

C. Correlation-scales 

The relaxation of glassy systems may take place on 
many different time scales. A precise definition of 
"correlation-scales" was given in [7]. Assuming that a 
chosen two-time correlation, C, is a monotonic func- 
tion of both times t and t w , in the long waiting-time 
limit, one can relate the values it takes at any three 
times using a time-independent function. More precisely, 
C(t!,t 3 ) = f[C{h,t 2 ),C{t 2 ,t 3 )] for h>t 2 > h when all 
three times are very long. 

The correlation scales are defined as follows. Within a 
correlation scale, f(x,y) = ]^ 1 []{x)j{y)\ and C(ti,t 2 ) = 
j _1 [/i(£i)//i(£2)] with h(t) a monotonic function of time 
and j(x) another function. Between correlation-scales the 
function / is "ultrametric" , f(x,y) = mm(x,y). 

To explain this definition with an example, the corre- 
lation function C(t,t w ) = (1 — g EA )exp[— (t — t w )/r\ + 
QEA.(tw/t) decays in two scales that are separated at the 
value C = q EA that one sees as a plateau in C that de- 
velops at long t w in a plot against t — t w in logarithmic 
scale. The first scale is stationary and characterized by 
h&r(t) = cxp(— t/r), the second one ages and is charac- 
terized by h AG (t) = t. 

The structure of scales can be different for different 
correlators. The local correlations defined in Eq. (5) [or 
in Eq. (7)] are different observables labelled by i. Their 
decay should follow these generic rules whenever one can 
assume that they are monotonic. 

D. Behavior of global two-time quantities 

In the long waiting-time limit, taken after the thermo- 
dynamic limit, one can prove analytically that a sharp 
separation of time-scales characterizes the dynamics of 
mean- field glassy models [7,9,48-50]. A similar separa- 
tion of time-scales has been observed numerically [51-54] 
and experimentally [21] in a variety of glassy systems. In 
short, one finds: [55] 



(i) a fast stationary evolution at short time-differences 
in which the correlation approaches a plateau defined as 
the Edwards- Anderson parameter 

q EA = lim C ST (t-t w )= lim lim C(t,t w ) , (9) 

t—t w — >oo t—t w — >oot w — *oo 

with the integrated response linked to the correlation by 
the fluctuation-dissipation theorem (fdt) 

X ST (i -t w )= lim x(t,t w ) 

t w —*oo 

= ^[l-C ST (t-t w )], (10) 

and, in particular, 

lim lim x(t, t w ) = 4(1 - <7ea) • (H) 

t — t w — >oot w — >oo ± 

This regime is also called time-translational invariant 
(tti). In general, the decay in this regime is not ex- 
ponential (c/r. the example given in Sec. II C). 

(ii) A slow aging relaxation for longer time-differences 

C(t,t w )^C(t-t w ) , 
X{t,t w )^ X (t-t w ) , (12) 

when the value of the global correlation drops below q EA 
[and the integrated response goes above (1 — q EA )/T]. 

The number of scales that appear in this second de- 
cay depends on the model considered. For the fully- 
connected p spin model a single correlation-scale has been 
found below q EA in which the global correlation scales 
with a power law, h AG (t) — t [9,56]. A sequence of global- 
correlation scales exists in the analytic solution to the SK 
model [7,48]. For a manifold moving in an infinite di- 
mensional embedding space with a short-ranged random 
potential one finds that the Fourier modes of the corre- 
lation C r (t,t w ) — j v d d r' '{4>(r + r 1 ,t)4>{r l ,t w )) decay on 
two scales that are separated at a fc-dependent Edwards- 
Anderson value, q£ A [49]. The functions /i S t,ag that char- 
acterize the two scales arc identical for all wave-vectors. 
This has also been found in molecular dynamic simula- 
tions of Lcnnard- Jones mixtures [53,54]. If the mani- 
fold feels a a long-ranged random potential [49,50] the 
fc-modes decay in a sequence of scales. If this structure 
exists in any non- mean- field problem it is not clear yet. 
In particular, the 3d EA model behaves more like a model 
with only two global-correlation scales [51] but this may 
be due to the shortness of the simulation times. In more 
complex problems one could even find that different cor- 
relators decay on totally different time scales. 

In the second time regime the fdt is not satisfied. 
However, in many glassy models evolving out of equi- 
librium the global correlation [Eq. (3)] and the global in- 
tegrated response [Eq. (4)] are linked in a rather simple 
manner [7]. Indeed, assuming that the global correlation 
decays monotonically as a function of t, one can invert 
this function and write t = / g " 1 (C(t, t w ), t w ) and 



G 



X{t,t w ) = Xtfn 1 (C(t,t w ),t w ),t v 



(13) 



1. Local Edwards- Anderson parameter 



implying 



lim x{t,t w )=x{C) 

t m ^oo C(t,t w )=C 



(14) 



where C is held fixed as we take the limit which we as- 
sume exists. We call Eq. (14) a fluctuation-dissipation 
relation (fdr). In equilibrium x(C) = (1 - C)/T holds 
for all values of C. Out of equilibrium one finds a differ- 
ent relation with a kink: when C > g EA the equilibrium 
result holds, x(C) = (1 — C)/T; when C < q EA a non- 
trivial functional form x(C) is found and its particular 
form depends on the model or system considered. For 
disordered spin models of the mean-field type two types 
of curves have been found: 

(i) For p spin models it is a broken line with two different 
slopes, one being the negative of the inverse temperature 
of the bath for C e [g EA , 1]; the other has a different slope 
and spans the interval C € [0, g EA ] [9,56]. 

(ii) For the SK model the construction also has a breaking 
point at q EA separating a straight line with slope minus 
the inverse temperature of the bath for C G [q EA , 1], and 
a curved piece for C € [0, q EA ] [7]. 

In the case of the random manifold the form of the 
modifications of fdt depend on the range of correlation 
of the random potential [49]. One finds a linear rela- 
tion between the Fourier modes of the space-dependent 
correlator and susceptibility if it is short-ranged and a 
non-linear form if it is long-ranged. Moreover, one finds 
that all modes behave essentially in the same way in both 
cases. We shall discuss this issue in Sec. II F. 

Several simulations support the fact that the FDR of 
global quantities in models for structural glasses, such 
as Lennard- Jones mixtures, behave like a manifold in a 
short-range correlated random potential, for which the 
second slope does not vanish and is equal for all the wave- 
vectors k [53,54]. In the case of the 3d EA model the 
numerical results were interpreted as supporting the ex- 
istence of a curve with non-constant slope below q EA [57]. 
Similar conclusions were drawn from the experimental 
work presented in [58] . The numerical and experimental 
data are still rather far from the asymptotic time limit, 
and, in our opinion, it is quite difficult to decide from the 
present data if x(C) is indeed curved or a straight line 
below <7 EA . 



E. Behavior of local correlations 

In this section we denote by Ci a generic local corre- 
lation that has been coarse-grained, noise-averaged, or 
smoothed with any other prescription. We first discuss 
the possible time dependences of individual correlations 
at a very general level. Later we distinguish between 
coarse-grained and noise-averaged values. 



Similarly to our discussion of the decay of the global 
correlation, see Eq. (9), one can define a local Edwards- 
Anderson parameter as the value of the local correlation 
separating fast and slow decays, 



q EA = lim lim Ci(t,t w ) 

t — t w —>oo t w —>oc 



(15) 



The local correlations should decay quickly towards q EA 
and then slowly below this value. If the structure of the 
global correlation is preserved at the local level, the first 
step of the relaxation should be stationary whilst the 
second one could be waiting-time dependent. 

Site-to-sitc fluctuations in q EA are possible. For some 
spins the local Edwards- Anderson parameter may vanish, 
i.e. q EA = 0, and they may only show the first, fast 
decay. These are the fast spins identified in Refs. [36-38] 
in purely noise averaged local correlations. However, one 
expects the fluctuations in q EA to be smoothed by spatial 
coarse-graining and to disappear if a sufficiently large 
coarse-graining volume V is used [34] . 



2. Slow local relaxation 

What about the decay of the local correlations below 
the plateau at q EA ? Any monotonically decaying two-time 
correlation within a correlation-scale behaves as [7] 



Ciit : t w ) fi 



hj(t) 

hi {tin) 



(16) 



There are two special cases that deserve special mention. 
On the one hand, the scaling arguments hi(t) could be 
site-independent, hi(t) = h(t), and thus 



Cj(ij t w ) — fi 



h(t w ) 



(17) 



On the other hand, the external function fi could be 
independent of the site index i and the scaling could take 
the form 



Ci{t, tw) — f 



hi(t) 



(18) 



This allows several combinations. The main ones to be 
discussed below are: (i) the scaling in Eq. (17) holds for 
all sites in the sample, (ii) the scaling in Eq. (18) holds 
everywhere in the sample. Evidently, one can also have 
more complicated behaviors: (hi) parts of the sample 
scale as in Eq. (17), other parts scale as in Eq. (18), and 
still other parts do not satisfy either of the special forms 
but are described by the more general form (16). Note 
that the noise-averaged and coarse-grained local correla- 
tions do not necessarily scale in the same way. 
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We first explore the consequences of having the behav- 
ior in Eq. (17) for all sites in the sample. For simplicity, 
let us first assume that the global correlation decays in 
a single correlation-scale once its value drops below the 
global Edwards- Anderson parameter, 



C{t, t w ) — fg 



C < q EA . 



(19) 



This is the behavior of fully-connected p-spin models with 
p > 3 [9]. One can expect it to hold in dilute ferromag- 
netic p = 3 spin models [38] and, surprisingly, it is also 
suggested by numerical simulations in the 3d EA model, 
at least for the waiting and total times explored [51]. If 
the hypothesis in Eq. (19) holds, the h(t) in Eq. (17) 
must be identical to h g (t), and one can write 

Ci(t,t w ) = ft {f-\C{t,t w ))) = MC(t,t w )) . (20) 

For all pairs of times (t,t w ) leading to a fixed value of 
the global correlation, C(t,t w ) = C, one has 



Ci(t,t w ) = fi(C) 



(21) 



All local correlations are then site-dependent functions 
of the global correlation. Following the line of thought 
in Ref. [7] one can extend this argument to the case with 
a global correlation that decays over many time scales. 
If one assumes that the global correlation is monotonic, 
one can write Cj as a function of C(t,t w ) and t w using 
t = /~ 1 (C(f, t w ), t w ). If one further assumes that in 
the limit t w — > oo with C(t,t w ) = C fixed each local 
correlation approaches a limit, then 



lim Ci(t,t w ) = fi(C) 

*oo,C(t,t„)=C 



(22) 



This means that within each correlation scale all local 
correlations are locked into following the scaling of the 
global one. 

Replacing the local space index i by a wave vector 
fc, this is exactly the behavior of a finite dimensional 
manifold embedded in an infinite dimensional space [49] . 
When the random potential is short-range correlated the 
dynamics are such that there are only two correlation 
scales in the problem, a tti one satisfying fdt and an ag- 
ing one in which all fc-dependent correlators decay below 
q* A as in Eq. (17). Instead, when the random potential is 
of long-range type, the correlations have a tti scale that 
ends at a fc-dependent Edwards- Anderson plateau, q EA , 
and a subsequent decay that takes place in a sequence of 
scales. All modes are locked in the sense that for all times 
one can write Ck = /fe(Co) where the argument can be 
any chosen mode, for instance, the fc = one. The for- 
mer behavior was also found numerically in the fc modes 
of the incoherent scattering function of a Lennard-Jones 
mixture where there is only one correlation scale below 
the fc-dependent q* A [53]. Recently it was also proposed 



for all site dependent correlators in the context of a fer- 
romagnetic model on a random graph in Ref. [38] and for 
the 3d EA model in Ref. [46]. In these cases the corre- 
lations and susceptibilities were averaged over the noise 
with no spatial coarse graining. 




FIG. 1. Example of scaling functions h 



Be- 



cause the functions h it j(t) cross, there are pairs of times (i, t„ 



for which d > Cj , but others for which d < Cj , even though 
hi t j{t) only fluctuate slightly around the scaling function h(t). 

Instead, if the hypothesis in Eq. (18) holds, there are 
many open possibilities. For instance, different sites can 
evolve on totally different time-scales. A simple exam- 
ple illustrating this point is given by two sites i and 
j that decay below their Edwards- Anderson values to 
zero in only one scale but that are different: Ci(t,t w ) = 
ql A (\nt w )/(\nt) and Cj(t,t w ) — qi A t w /t. In this case, 
site i decays on a slower scale than site j. There is also 
the possibility that, while being in the same correlation 
scale, the value of the correlations at two sites i, j may 
cross each other as a function of time. Let us be more 
explicit; consider two sites with local scaling functions 



hi(t) = h(t) 
hj(t) = h(t) 



Sh t (t) , 
8h 3 (t) , 



(23) 



with \Shij(t)\ <C h(t), so that the sites evolve within the 
same scale. [Note that both hi(t) and hj(t) are mono- 
tonic functions.] In this case, one can expand the expres- 
sion in Eq. (18) and write: 



Ci(t, t w ) ~ / 



h(t w ) 
h(t) 



1 



6hj(t) _ 5hj(t w ) 
h{t) h(t w ) 



(24) 



+f 



h(t) \ h(t) fShi{t) 5hi(t w y 



h{t w )J h{t w ) \ h(t) 



h(ty 
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and similarly for Cj(t,t w ). At any pair of times (t : t w ) 7 
the difference between the two local correlations is 

d - Cj cx 5h ^ t )- 5h 3 { ^ t ) _ Shj(t w ) - 6hj(t w ) ^ 



hit) 



h(t w ) 



In general, the right-hand-side (r.h.s.) of Eq. (25) can 
change sign as a function of the two times t and t w , 
allowing for sorpassi (passing events) between different 
sites. An example of functions hi and hj for which these 
sorpassi are realized is shown in Fig. 1. 

Finally, one could also find cases in which Shij(t) are 
large [|<5/ijj(i)| <C h(t) is not satisfied] and the sorpassi 
can be such that Cj and Cj move across correlation scales. 
These variations are quite dramatic. One could expect 
them to be penalized in such a way that they appear less 
frequently than the ones in which \Shij(t)\ -C h(t). Wc 
shall return to this issue in Sec. III. 



F. Behavior of local responses and 
fluctuation-dissipation relation 

Let us define a generalized local fluctuation-dissipation 
relation (fdr) via the limit 

Urn Xi(t,t w ) =Xi(Ci) . (26) 

t w ^oo Ci(t,t w )=Ci 

This limit exists whenever the local correlations are not 
multivalued, i.e. if they are monotonic functions of t for 
fixed t w . Indeed, in this case one can invert for the time 



t / (C (£, t w ) : t w ) , 



and write 



Xi^Pl ^w) — Xi(/ (C(£, t w ) : t w ), t w ) . 



(27) 



(28) 



Taking the limit t w — > oo while keeping Cj(i, t w ) fixed to 
Cj one recovers Eq. (26). 

The question now arises as to whether the fluctuations 
in d and Xi are independent or whether they are con- 
strained to satisfy certain relations. 

Based on thermometric arguments [59], we shall asso- 
ciate the variation of Xi wrtn respect to d to a local 
effective-temperature. We would also like to know if the 
values of the local effective-temperatures are constrained 
or can freely fluctuate. 

In the rest of this subsection we discuss different sce- 
narios for the behavior of the joint probability distribu- 
tion (pdf) p(d 7 Xi) computed at two fixed times t and 
t w . We also discuss the behavior of the fluctuations in 
the local effective-temperature. In order to illustrate dif- 
ferent possibilities we present several plots that sketch 
the following construction. Given a pair of times t w < t, 
we depict the N points (C(i, t w ), T\i{t 1 t w )) with arrows 
that represent the velocity of the points [i.e, the rate at 



which the (Ci,Txi) positions change as one changes t], 
and are located at their position in the C — T\ plane. 
Note that all these points are evaluated at the same pair 
of times (t,t w ). For the sake of comparison, in the same 
plots we also draw the parametric plot for the global 
Tx(C) constructed as usual [7]: for a fixed t w we follow 
the evolution of the pair (C, T\) as time t evolves from 
t = t w to t — > oo. 

In the figures showing the distributions of (Cj, Xi) pairs 
we scale the y-axis by temperature to work with dimen- 
sionless variables. This is important to compare the ex- 
tent of fluctuations in the two directions. 



1. Similar times 

Let us first discuss the case in which the two times t 
and t w chosen to evaluate the local correlation and inte- 
grated linear response are close to each other, in such a 
way that the global correlation between them lies above 
the Edwards- Anderson parameter. In this case the global 
correlator and the global linear integrated response are 
stationary and related by the fdt. In this regime of 
times we also expect the local quantities to be linked by 
the fdt. 

When studying noise-averaged two-time quantities one 
can actually use the bound derived in Ref. [60] to justify 
this claim. For coarse-grained quantities we do not have 
an analytic argument to use but we find this expectation 
very reasonable. Note that the arguments put forward in 
Sec. Ill do not apply to these short time-differences since 
they hold for the slowly varying part of the two-time 
functions only. We have verified numerically that the 
fluctuations of the local coarse-grained correlations and 
responses are concentrated rather spherically around the 
global value * = (1 - C)/T when C > q EA [34]. 



2. Far away times: no constraint 

We now choose two times t and t w such that the global 
correlation taken between them is less than q EA . 

The simplest possibility is that the fluctuations in Cj 
and Xi are independent. If these are not specially con- 
strained the pairs (Cj,Txi) can be scattered almost ev- 
erywhere on the C — T\ plane. 

The scaling in Eq. (16) means that different sites might 
evolve on different time-scales. This could happen, for 
example, if hi{t) = t and hj(t) = \n(t/t ). Hence, one can 
expect each site to have their own effective temperature, 



—0i 



(29) 



This situation is sketched in Fig. 2. 
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TX, 




EA 



c. 



I 



FIG. 2. Sketch of the local FDR between integrated re- 
sponses and correlations on all sites, at a fixed pair of times 
(t,t w ) such that the global correlation goes below q EA . In this 
case neither the positions of the pairs (d,Txi) nor the ve- 
locities of the points, i.e. the direction of the arrows that 
are associated to the effective temperatures, are constrained. 
This case represents Eqs. (16) and (29). The full line sketches 
the parametric plot x(C) for the global quantities in a model 
with two (straight line below g EA ) and a model with a se- 
quence of global correlation-scales (curve below 9ea)- The 
dashed line is the continuation of the section where the fdt 
holds. The black dots indicate the location of the averaged 
values for the susceptibility and correlation, Xav = 1/N},. Xi 
and C A v = 1/N^2-Ci at the times t and t w . 



3. Far away times: locked scales 



and a system with a continuous sequence of correlation 
scales, respectively. 

TX, 




EA 



c. 



FIG. 3. Fluctuations in a system with only two correlation 
scales defined using the global correlator. The plot shows 
fluctuations in the local Edwards- Anderson parameter, q\ A . 
(t,t w ) are such that the global correlation goes below q EA and 
the pairs (d, T\i) are not constrained to lie close to the global 
curve, x(C), indicated with a full broken line. The effective 
temperature is the same for all sites, as shown by the fact that 
all arrows are parallel to the second piece of the global curve. 
Consequently, once a site enters a "track" after leaving g EA 
(indicated with straight lines drawn with dots), it will follow 
it as time t evolves. The dashed line is the continuation of 
the part where the fdt holds. The black dot indicates the 
location of the values for the susceptibility and correlation 
averaged over the distribution. 



Naturally, one expects that the fluctuations in the local 
correlations and integrated linear responses at far away 
times are not completely independent and that they are 
constrained to satisfy certain relations. Here we explore 
the consequences of the scaling expressed in Eq. (22) for 
all sites in the sample. Hence, 

lim Xi(t,t w ) = Xi(/i(C)) = Xi(C) , (30) 

t„^oo C(t,t w )=C 

with C the chosen value of the global correlation. Note 
that there is no constraint on the values of Xi(C) and 
Ci = /t(C). Thus, the pairs (d,Txi) can be scattered 
all over the plane. 

However, since all sites are locked to evolve in the 
same time-scale as the global correlation for each choice 
of times (t,t w ), one expects 

_p r{Ci) = ^Mp = _^ E f F(c) t (31) 

based on the expectation of having partial equilibration 
between observables in the same time-scales [59]. Thus, 
if the scaling in Eq. (22) holds for all sites in the sample, 
there should be a site independent effective temperature. 

The content of Eqs. (20) and (31) is illustrated in 
Figs. 3 and 4 for a system with two correlation-scales 




FIG. 4. Fluctuations in a system with a sequence of corre- 
lation scales defined using the global correlator. The points 
are scattered on the plane with no constraint on their po- 
sitions. The local Edwards- Anderson parameter fluctuates. 
The velocities with which the points move are all the same. 
Their positions are not constrained but their velocity moduli 
and directions are all identical. This is given by the slope at 
the value of the global correlation at the chosen times (t,t w ), 
indicated with a black dot on the global line. 

Note that in this time regime, at longer times t the 
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points will also be scattered on the plane but the average 
of the correlation will take a smaller value. Since this 
determines the velocity of the points (and their effective 
temperature) the direction of the arrows will be different. 
We can say that there is a nonvanishing acceleration. 

One finds two correlation scales in the noise and disor- 
der averaged wavevector-dependent two-time functions 
of a d dimensional manifold moving in a short-ranged 
random potential in infinite dimensions [49]. It has also 
been found in the noise-averaged local dynamics of a di- 
lute ferromagnetic model [38] and in molecular dynamic 
simulations of Lennard- Jones mixtures [53,54] for differ- 
ent wave- vectors. 



4- Far away times: fluctuations in time-scales 

As opposed to the case just discussed, the scaling in 
Eq. (18) means that different sites might evolve on dif- 
ferent time-scales (if \Shi\ ^S> h(t)) and hence have their 
own effective temperature. 

As we shall argue in Sec. Ill, under certain circum- 
stances the local responses and fluctuations are con- 
strained to follow the global curve, i.e. 



Xi(Ci) = x{Ci) , 



(32) 



with C and x(C) defined in Eqs. (3) and (14), respec- 
tively. Then we have 



-arid) 



dXi(Oi) dx(Ci) dx(C) 



dd 



da 



dC 



(33) 



If there are only two time-scales for the decay of 
the global correlation and, below the global Edwards- 
Anderson parameter, x{C) is linearly dependent on C, 
this equation yields 



(34) 



for all sites, and values of C{ < q EA . 

If, on the contrary, the global correlation decays in a 
sequence of scales and x(C) is n °t a linear function of 
C, one has fluctuations in the local effective temperature 
due to the fluctuations in d. 

This behavior is sketched in Figs 5 and 6 for a system 
with two global correlation-scales and a system with a 
sequence of global correlation-scales, respectively. In [34] 
we showed that the coarse-grained two-time quantities in 
the 3d EA model behave as in Fig. 6. We expect that the 
coarse-grained two-time correlators of structural glasses 
will show a behavior as in Fig. 5. 



TX, 




EA 



c. 



I 



FIG. 5. Fluctuations in a system with a single correlation 
scale below the Edwards- Anderson plateau. The constraint 
on the location of the pairs (d,Txi) implies that there are 
no fluctuations of the local Edwards- Anderson parameter and 
that all pairs are concentrated along the global straight line 
with little dispersion perpendicular to it. The arrows have 
the direction of the second slope in the global x(C) curve due 
to the result in Eq. (34). As in previous figures, the dashed 
line continues the fdt line and the black dot indicates the 
location of the values for the susceptibility and correlation 
averaged over the distribution. 



TX, 




EA 



c. 



FIG. 6. This is the possibility expressed in Eqs. (32) and 
(33) for a system with a sequence of correlation scales below 
the global g E A. All point positions are constrained to be near 
the global x(C) curve for C < g EA [Eq. (32)], and their ve- 
locities are forced to be parallel to the global x(C) curve for 
C < g E A [Eq. (33)]. The velocities fluctuate from site to site, 
but since they are determined by the global curve, they are 
identical for all sites with the same value of the local correla- 
tion d. The dashed line and the black dot are as in previous 
figures. 



III. CONSTRAINTS ON THE LOCAL 
FLUCTUATIONS 



We recently studied the symmetry properties of the 
dynamic action for the aging dynamics of finite, d- 
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dimensional spin-glasses [33]. Using the Schwinger- 
Keldysh functional formalism we derived a disorder- 
averaged dynamic generating functional that is a path 
integral over local two-time functions, Qf 13 \t,t w ), with 
a, (3 = 0,1 labelling the Kcldysh components (see details 
below) . This generating functional becomes the classical 
one, derived in Ref. [61], when h — ► 0. This treatment 
allowed us to discuss the classical and quantum problems 
simultaneously. The aim of that work was to show that 
the slow part of the action is a fixed point of a group of 
time-reparametrizations (RpG) and to build upon this re- 
sult an argument to constrain how the local fluctuations 
should behave in time and space. Here we recall this ar- 
gument and summarize its main consequences. Indeed, 
one of the main results arising from this analysis is that 
the coarse-grained two-time quantities should behave as 
in Fig. 5 or Fig. 6 if the global correlations decay on one 
or a sequence of scales, respectively. 



A. Time-reparametrization transformations 

The local two-time fields Q"^(t, t w ) are related to the 
fluctuating local physical two-time functions. For exam- 
ple, the expectation values ((Q" 13 (t,t w ))) (we use ((• • •)) 
to denote expectation with respect to the Q-action S[Q}) 
give the disorder and thermal averaged local correlations 
and instantaneous responses: 

({Q°i°(t,t w ))) = {{Q?(t,t w ))) 

= ^2K ij [C™(t,t w )} =^ K ^ j (t)s j (t w ))} , (35) 

3 3 

((Q° i 1 (t,t w ))) = ((Q?(t,t w ))) 

= E^^r(M.)] = E^4ISrY 1- ( 36 ) 



The connectivity matrix contains the variance of the 



random exchanges Jjj . 
Anderson model with 



For example, for the Edwards- 
Gaussian distributed disorder, 



Kij = J for nearest neighbors i,j, and zero otherwise. 
Notice that the ({Qf 13 }} are already an average over a 
small region around site i (because of the ) even be- 
fore coarse graining. There are two other components of 
the 2 x 2 matrix Qf. Q\ a {t,t w ) = Qf(t,t w ) is related 
to the advanced response and the remaining two-time 
function Qj 1 ^,^) = Qf(t,t w ) is related to a correlator 
whose average ((Qf(t,t w )}} vanishes for all causal prob- 
lems. The two-time fields Q^ 3 {t,t w ) in the action are 
fluctuating quantities. 

We defined a time-reparametrization transformation 
t — > h(t) that acts on the fluctuating fields Q" (t,t w ) 
as [33,48] 



<r<M„> s (^>y 



dh(t v 
dt in 



Qf(h(t),h(t w )) 



(37) 

where and are the advanced and retarded scal- 
ing dimensions of the field Qi under the rescaling of the 
time coordinates [48]. These transformations generalize 
the well-known ones for the expected values of the global 
Q's [5-7,50,61-64] to the local and fluctuating case, with 
h(t) a differentiable function. This choice of transforma- 
tion is motivated as follows. 

Since the local fields Qi are related to the local cor- 
relation, linear response and causality breaking correla- 
tor, it is natural to associate with them the same scal- 
ing dimensions that correspond to the global counter- 
parts of these two-point functions. The appearance of an 
(approximate) time-reparametrization invariance of the 
slow part of the relaxation was noticed long ago in the 
asymptotic solution of the dynamics of mean-field mod- 
els [5-7,50,61-64]. Indeed, when one studies the effective 
dynamic equations for the slow decay, one drops the time- 
derivatives and approximates the time-integrals. These 
approximations can be justified because the neglected 
terms are irrelevant in the RpG sense [48]. After apply- 
ing these approximations the resulting equations become 
invariant under time-reparametrizations that transform 
the global correlator and linear response according to 



C(t 1 ,t 2 ) = C(h(t),h(t w )) 
dh(t w ) 



R(t, t w ) 



dt„ 



R(h(t),h{t w ))6(t-t w ) 



(38) 
(39) 



for any differentiable and monotonic function h(i) [65]. 
Note that once one proposes this transformation of the 
correlator, the transformation of the linear response is 
forced to take the form in Eq. (39) if one wishes to pre- 
serve their link via the FDT. 

Extending these definitions to the local and fluctuating 
fields Qi we propose: 



(Af.Af) 


= (0,0), 


(40) 


(A?,Af ) 


= (o,i), 


(41) 


(A?,Af) 


= (1,0), 


(42) 


(Af,Af) 


= (!,!)• 


(43) 



This explains the choice of indices 0, 1 for the Schwinger- 
Kcldysh components, which conveniently label both the 
matrix components and scaling dimensions at the same 
time. 

Note that all sites are transformed in the same way 
under the reparametrization of time just defined. This 
is a global transformation that leaves invariant any local 
FDR of the form 



dt'Qf{t,t') = f{Q™{t,t w )), 



(44) 
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cfr. Eq. (37). This relation is a "constant of motion" 
with respect to this symmetry. Explicitly: 



/ dt'Qf{t,t')-- 
Jt w Jt 



= f dtiQf{h,ti) = f{Q™{h,h w )) 
= f{QT{t,t w )) . 



(45) 



These transformations imply that the physical noise 
and disorder averaged saddle-point values transform as 
expected, 

[Cr(t,t w )]^[Cr(h(t),h(t w ))] , (46) 

[X7(t,t w )}^[xr(h(t),h(t w ))}, (47) 
and the FDR in Eq. (26) is respected. 

B. Invariance of the action 

In Ref. [33] we studied the symmetries of the action 
S[Q]. We showed that the long-time limit of the effective 
Landau-Ginzburg aging action for the two-point func- 
tions Qi(t,t w ) is a fixed point of the group of time 
reparametrizations (RpG). By this we mean that, af- 
ter separating the field Qf(t,t w ) = Qf FAST (t,t w ) + 
Q"^ ShOW {t,t w ), and then integrating out the fast part of 
the fields, all terms in the effective slow action are in- 
variant under a reparametrization of time, t — > h(t), that 
transforms the fields as in Eq. (37). In deriving the effec- 
tive action for the slow contribution Qf^ SLOW (t, t w ), we 
assumed that there is a local separation of time scales. 
The only other ingredient in the proof was that the sys- 
tem must be causal. 

The approach to the fixed point is asymptotic, and 
there will be corrections to scaling at finite times. In 
particular, the kinetic contribution to the effective action 
is irrelevant at long times. However, irrelevant as it is at 
long times, this term acts as a (time-decaying) symmetry 
breaking field that selects a particular reparametrization. 

The importance of what we have shown is that it holds 
for infinite and short-range models alike, and at the level 
of the action, not just the equations of motion. Moreover, 
it suggests an approach to study spatial fluctuations of 
aging dynamics, as we discuss below. 



C. Implications of RpG invariance — connection with 
a sigma model 

In view of this approximate (asymptotic) symmetry we 
constructed an argument that allowed us to predict how 
the local fluctuations of the disordered averaged theory 
should behave. In this section we explain in more detail 
the arguments sketched in [33,34]. 



1. Parallel with the O(N) model 

To better explain the argument, it is useful to explore 
an analogy with the static, coarse-grained, O(N) theory 
of magnets in d dimensions: 



H= d d r (V • m(f)) 2 + H • m(f) + V{m) 



(48) 



where m(r) is a continuous TV-dimensional variable, 
m(r) = (to 1 (r) , to 2 (r '),..., m N (r)) , that represents the 
local magnetization. V(m) is a potential energy with 
the form of a Mexican hat. H is an external magnetic 
field. A particular case of this model is the well-known 
3c? Heisenberg ferromagnet obtained when N = 3 and 
d = 3. 

The parallel between the two models is as follows. 

1. Fields - The two-time fields Q" (t, t w ), once coarse- 
grained over a volume V, play the role of the static mag- 
netization m(r). 

2. Symmetry - When H — the energy function of the 
magnetic problem is invariant under a global rotation of 
the magnetization, m a (f) = R ab m b (r) (R ab (r) = R ab , 
for all r). The potential V{fn) has a zero mode along the 
bottom of the Mexican hat potential. 

In the dynamic problem, for longer and longer waiting- 
times, the symmetry breaking terms become less and less 
important and the action progressively acquires a global 
symmetry (a zero mode develops). 

3. Spontaneous symmetry breaking - In the absence of 
a pinning field, the ferromagnetic model spontaneously 
chooses a direction of the vector to everywhere in real 
space, m(r*) = Too in the broken symmetry phase. 

In the RpG invariant asymptotic regime, the minima of 
the dynamic action satisfy the global reparametrization 
symmetry. A given direction in the minima manifold is 
described by one uniform time-reparametrization every- 
where in space, h(r, t) = h(t), 

4. Explicit symmetry breaking - A non-zero magnetic 
field H breaks the symmetry explicitly by tilting the 
Mexican hat potential. It forces the magnetization, to, 
to point in its direction in the N dimensional space ev- 
erywhere in the real rf-dimensional space. 

RpG irrelevant terms, which vanish asymptotically, 
play the role of (time-decaying) symmetry breaking fields 
that select a particular time-reparametrization. The par- 
ticular scaling function h{t) chosen by the system is de- 
termined by matching the fast and the slow dynamics. 
It depends on several details - the existence of external 
forcing, the nature of the microscopic interactions, etc. 
In other words, the fast modes which are absent in the 
slow dynamics act as symmetry breaking fields for the 
slow modes. 

5. Fluctuations - These correspond to smooth vari- 
ations in the magnetization as a function of position, 
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m(r) = fh{) + 5fh(r). There are two types of fluctua- 
tions, longitudinal and transverse. The former change 
the length of the magnetization vector, |m(r)|; these 
move off the saddle point manifold of potential minima, 
and are thus massive excitations. The latter change di- 
rection only, mo • Sm(r) — 0; these remain in the poten- 
tial minima manifold, and are massless excitations. The 
transverse fluctuations, which correspond to smoothly 
spatially varying rotations of the magnetization vector, 
are therefore the most energetically favored. These are 
the spin- waves or Goldstone modes in the O(N) model. 

The equivalent of the transverse modes for the 
dynamic Q-theory are smooth spatially-varying time 
reparametrizations, h(f,t) = h(t) +dh(f,t). Uniform or 
global reparametrization is the symmetry of the model; 
the smooth spatially fluctuating Sh(f, t) are excitations 
that cost the lowest action, or the Goldstone modes of 
the Q-action. 

What controls the distance scale on which the fluc- 
tuations can vary? The first term in the ferromagnetic 
model in Eq. (48) restricts the magnitude of the variation 
of the direction of rh. For the second model, one expects 
that a similar stiffness will be generated once it is coarse- 
grained, making sharp variations in 5h(f, t) difficult to 
achieve. 

The longitudinal fluctuations in the fcrromagnet, those 
in which the modulus of the magnetization vector 
changes, m = ttiq + 5m, cost more energy due to the 
Mexican hat potential and hence are less favorable. Sim- 
ilarly, in the dynamic problem the fluctuations in which 
the "external form" [for example, imagine the function / 
in Eq. (18) varying with position] of the coarse-grained 
two-time functions changes are less favorable. 

2. Spatial fluctuations of aging dynamics 

The penalties for longitudinal fluctuations, and 
the soft transverse fluctuations corresponding to local 
reparametrizations t — > h(r,t), led us to propose that 
the coarse-grained local correlations in the aging regime 
scale as in Eq. (17). In the C— T% plane, these soft modes 
correspond to displacements along the global x(C) curve; 
this is shown in Fig. 7. Displacements that move points 
off the x{C) curve are the longitudinal modes, which do 
not correspond to smoothly varying time reparametriza- 
tions. 

A natural consequence of this is the prediction that 
the fluctuations in the coarse-grained local fdr should 
be such that the distribution of points xTi^i 9 ) f°U° w 
the global fdr, x(C), defined in Eq. (14). Thus, Eq. (33) 
should hold (see Fig. 6). Given any pair of times (t,t w ) 
such that the global correlation equals a prescribed value, 
C(t,t w ) — C, the local effective temperature should be 
the same for all regions of space having the same value 
of the local correlation Ci(t,t w ). 




c 

I 

FIG. 7. Panel a): soft modes in the Heisenberg magnet. 
TV- dimensional sphere with radius |m (r)| centered at the spa- 
tial point f. The longitudinal and transverse directions for the 
fluctuations are indicated with arrows. Panel b): soft modes 
in the spatial fluctuations during aging. The full line repre- 
sents the global x(C) curve in a model with a sequence of 
correlation scales below q EA . The vertical dashed line shows 
the value of q EA separating the slow stationary decay (tti) 
from the slow aging regime. The directions for longitudinal 
and transverse fluctuations as explained in the text are indi- 
cated with arrows. 

We would like to remark that the above theoreti- 
cal argument was developed for the fluctuating fields 
Qi(t,t w ), not their thermal averages; these correspond, 
instead, to the expectation values ({Q"^(t, t w ))). The av- 
erage over the disorder is carried from the outset in the 
field-theoretical approach, while fluctuations due to noise 
histories are kept by writing the Q-theory using a path 
integral formulation. How can one test the predictions 
from this disordered average field theory against numer- 
ical simulations? The answer lies on whether the distri- 
butions that one studies are self-averaging or not. What 
we find is that, if we study coarse-grained local corre- 
lations and integrated responses [34] through numerical 
simulations, their distributions become independent of 
the disorder realization for large enough coarse-graining 
cell sizes. This is an indication that self-averaging holds 
for these non-equilibrium distributions, and in fact the 
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coarse-graining procedure is somehow averaging over dis- 
order. This is perhaps another reason to work with 
coarse-grained quantities, as opposed to noise averaged 
quantities. 

What can we say about the behavior of noise-averaged 
(and neither disorder averaged nor coarse-grained) local 
two-time functions? We argue that this procedure cor- 
responds to "fingerprinting" the particular disorder real- 
ization of the system. By a "fingerprint" of disorder we 
mean that noise-averaged correlations and integrated re- 
sponses at the different sites purely reflect their disorder 
environment, since there is no other source of fluctuations 
left in the problem. Of course, further averaging over the 
disorder would erase the "fingerprint", and simply give 
the global result. For this reason, coarse-graining also 
erases the "fingerprint" for a self-averaging system. The 
noise-averaging approach should correspond to the scal- 
ing in Eq. (17), and fluctuations are then not constrained 
to follow the global x(C) curve, as in Fig. 6. 



D. Random surface action — effective action for the 
fluctuations 

In the spirit of the usual approach in deriving a coarse- 
grained effective action for the relevant fields in a prob- 
lem [45], we search for the "minimal" effective action 
describing the aging dynamics of the system in terms 
of coarse-grained fields Q a/3 (f;t 7 t w ). More precisely, in 
Sec. Ill A we mentioned that the dynamic generating 
function is expressed in terms of local two-time fields, 
Q"^(t,t w ), that are coarse-grained over a cube involv- 
ing the first neighbors of the site i. Since we are inter- 
ested in postulating an effective action for the soft fluctu- 
ations we shall consider a further spatial coarse-graining 
of these fields and work with Q al3 (r, t, t w ) that represents 
a smooth two-time field at the position r in real space. 

In a coarse grained theory, one expects gradient terms 
to be present in the effective action. Their effect is to 
penalize rapid variations (in time and space) of the coarse 
grained fields. These terms play the role of the term 
/ d d r (V-m(r)) 2 in the energy Eq. (48) for the Heisenberg 
ferromagnet. 

As we discussed above, global RpG invariance is, in 
the limit of long times, a symmetry of the total action 
and we should preserve it when constructing the effective 
action for the fields Qf 13 (f;t,t w ). Thus, this symmetry 
poses strong restrictions on the form of allowed gradient 
terms. 

In general, the effective action takes the form: 



S[Q] — 5 gra d[Q] + Slocal[<9] : 



(49) 



with Siocai[Q] an RpG invariant action comprised solely 
of local terms and 5 gra d [Q] including the gradient (non- 
local) dependence. Let us propose, for the latter, 



//>oo />OC 
d d r / dh / dt 2 (Vd tl Q 00 (f;t 1 ,t 2 )) 
Jo Jo 

x (Vd t2 Q 00 (f;h,t 2 )) • (50) 

Notice that a global RpG transformation t — ► h(t), 
Q oa (r; t u h) -> Q 00 (r; h,t 2 ) = Q 00 (f; h{h),h(t 2 )) leaves 
<Sgrad[<2] invariant as well, as can be explicitly checked: 



Sgrad [Q] 



oo />oo 

d d r I dh 
o Jo 



dt 2 (yd tl Q m {r;t u t 2 )) 

x (vd t2 Q 00 (f;*i,*2)) 

/f-OO f-OO 
d d r / dh! / dh 2 (Vd hl Q 00 {f;h u h 2 )) 
Jo Jo 

x (Vd h2 Q oa (r; h u h 2 )) = S grad [Q] . (51) 



Before proceeding, we would like to remind the reader 
that Q 00 and C cg are indeed related, so what we 
discuss below applies to the spatially-varying coarse- 
grained correlation C cg (f;ti,t 2 ). The expectation value 
((Q 00 (f;ti,t 2 ))) is related to the noise (and disor- 
der) average of C cg (f;ti,t 2 ) [see Eq. (35)]. Simi- 
larly, one can show a relation between all n-moments 
((Q 00 {f 1 ;h,t 2 )---Q m {f n ;t 1 ,t 2 ))) and the noise (and 
disorder) average of C"s at n points. Hence, the fluc- 
tuations of these quantities are akin. 

The reader might also note that there are several other 
simple RpG invariant actions that we could have written 
down, involving either Q 01 and Q 10 , or Q 11 and Q 00 . 
However, such terms vanish when evaluated on a saddle- 
point configuration that satisfies causality. Since we fo- 
cus on the causal solution and its fluctuations, we do 
not consider such terms. The gradient penalizing term 
in Eq. (50) is chosen as one of the simplest non-trivial 
terms that respects RpG invariance. 

In analogy with the study of the O(N) model and the 
derivation of an effective action describing the spin waves, 
we start by identifying the uniform (in space) saddle 
point configuration and we then consider small fluctu- 
ations around it. 

Since the saddle-point solution does not depend on the 
spatial position, 5 gra d[Q S p] = 0. Thus, Q SP is completely 
determined by SiocailQ] an d its precise form depends on 
the details of the model. We argue that one can still learn 
a great deal about the spatial fluctuations by considering 
simplified, approximate saddle-point solutions. We know 
from numerical simulations of the 3d EA model [51,23] 
that the global correlation scales rather well as 



r<+ *\ ~ „ f( m HHh),h(t 2 )) 

<^(ti,t 2 ~ q EA J I — - 

\max(/i(ti), h(t 2 )) 



(52) 



with h(t) and f(x) two monotonic functions. f(x) sat- 
isfies /(l) = 1 and /(0) = 0. A very good scaling of 
the data is obtained using h(t) — exp(t 1_M / (1 — p)) with 
H taking values that are slightly above 1. The simpler 
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scaling h(t) = t is not perfect but it provides a rather 
good approximation. It will be convenient to define a 
new time-dependent function <f) by 

h(t) = e*<*> . (53) 

The role of spatially varying rotations in the O(N) 
model is here played by the spatially varying time 
reparametrizations that we write as 

h{t) ^ h{f,t) = . (54) 

Thus, we express the saddle-point solution as 

Q™(h,t 2 )*q EA f(e-^-^) , (55) 
and we parametrize the fluctuations around it with 

Q 00 (f;t 1 ,t 2 ) « g EA f (e-MW-+™\) . (56) 

Let us now split <f>(r,t) = r[h(t)] + 5(f)(f,t), where 
r[h(t)] selects the global reparametrization, i.e. fixes 
the "direction" of the saddle-point solution, and S<p(r, t) 
controls the small fluctuations around it. Furthermore, 
it is best to think of r as the proper time variable and 
work with p(r,r) = 8(j>{f,t(r)). Changing integration 
variables in S gra d[Q] from t to r, and expanding around 
small ip, we obtain [for the simplest case f(x) = x]: 

/poo poo 
d d r / dn / dr 2 (Vy>(r,n)) 
J — oo J— oo 

x(Vip(r,r 2 )) [l-ln-ral] 2 e -2|n-T„| 
= \ QL J d d r J™ dr (Vip(r, r)f + ■ ■ ■ , (57) 

where ip — dip/ dr. In Eq. (57) we retained only the 
leading relevant term (we neglected terms with higher r 
derivatives). It is very simple to show that in the case 
of a general function f(x) the resulting action is identi- 
cal to the above up to a renormalized stiffness constant, 
namely: 

S grad « \ A/ g E 2 A J d d r J dr (V0(r, r)f + • • • , 

(58) 

with 

\f=4:f dxx {[l + lnx]f'(x) +x\nxf"(x)} 2 (59) 

a positive definite constant. In particular, for a power 
law f{x) — x x , the renormalization factor of the stiffness 
is simply A/ = A. 

The p(f,r) that parametrize the fluctuations can be 
thought of as the height of a random surface. Equa- 
tion (56) relates the fluctuations of the local correlators 



with the reparametrization field (f>. In the case f(x) = x A , 
this relation takes the simple form 

Q°°(f-t 1 ,t 2 ) = Q™{t U t 2 ) e -A|*>(r,r(ti))- V (r,T(t 2 ))| ) (60) 

so spatial fluctuations of the correlations C cg (f; ti,t 2 ) are 
related to the fluctuations of the height differences from 
two p surfaces evaluated at two proper times n and t 2 , 
as sketched in Fig. 8. It is simple to understand how 
these height differences, which fluctuate as a function of 
time, can very simply explain the sorpassi we discussed 
in Sec. HE 2. 

What are the statistics of these height differences? Be- 
cause ip is a Gaussian surface, it is simple to show that 

([ip(f, n) - <p(P, t 2 )] 2 ) = 2G d (f, f) |n - t 2 \ , (61) 

where Gdir^r 1 ) is the correlation function for a Gaus- 
sian random surface in d-dimensions. When n and 
t 2 get close, irrelevant terms neglected in Eq. (57) be- 
come important, and |n — t 2 \ should be replaced by 
a short-time cut-off r c . The details of the crossover 
depend on those neglected terms, but one can capture 
its most important features by approximately replacing 
|n - t 2 \ -^t c + |n - t 2 \ in Eq. (61). 



X 




r 

FIG. 8. Schematics of the height separation between sur- 
faces ip(r, t) at different proper times n, • • • , T4. Notice that 
height differences for two different points r, f can increase 
or decrease for different pairs of r's. Such fluctuations can 
explain the sorpassi we described previously. 

The simple expression Eq. (61) has some powerful con- 
sequences. First, it implies that the statistical distribu- 
tion of local correlation functions C(r; ti,t 2 ) is controlled 
by the proper time difference t\—t 2 . Because r = In h(t) 
follows from the scaling of the global correlations of the 
EA model [51,23], we can conclude that the full PDF for 
the local correlations is also a function that scales with 
the ratio h(t)/h(t w ); this scaling is confirmed in our nu- 
merical simulations in the 3d EA model, as discussed in 
Sec. IV D, where for simplicity, we use h(t) w t. 
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Second, it suggests that fluctuations of the height dif- 
ferences are much more pronounced in 2d than in 3d. 
Gd(r, r), the correlation function for a Gaussian random 
surface in d-dimensions, goes to an ultraviolet cut-off de- 
pendent constant in 3d, but diverges logarithmically with 
the system size L in 2d. Hence, this may provide a sim- 
ple explanation why in 2d fluctuations destroy the global 
order in spite of the existence of non-zero local correla- 
tions. 

Additionally, Eq. (61) allows us to obtain more detailed 
predictions about the leading order behavior of the fluc- 
tuating reparametrization. Within the present approxi- 
mation, tp(r, Ti) — ip(f, t 2 ) is a Gaussian random variable 
with a variance given by the square root of the r.h.s. of 
Eq. (61). Combining this with the physical information 
that r(t) = hih(t) (where again for simplicity we can 
take h(t) as t for the scaling of the global functions), and 
noting 4>(r, t) = r(t) + 6(f>(r, t), we can write the following 
scaling form: 

<j)(r, ti) - 4>(r,t 2 ) = Inti - lnt 2 

+ [G d (r , f ) (r c + I In t 1 - In t 2 \ )] 1/2 X r (t 1 , t 2 ) 
= \n(t 1 /t 2 ) + [a + b\\n(t 1 /t 2 )\] a X r (t u t 2 ) , (62) 

where, to Gaussian level a = 1/2, and X r (ti,t 2 ) is a 
random Gaussian variable of unit variance and spatially 
correlated. Higher order corrections could in principle 
modify this prediction significantly. It turns out that 
simulational results [34] are consistent with Eq. (62), al- 
though with a 7^ 1/2 and with a non-Gaussian distribu- 
tion for X r (ti,t 2 ). 



data for these short waiting-times and up to the max- 
imum waiting-time reachable in simulations, which is of 
the order of 10 6 Monte Carlo steps (mcs). A better de- 
scription of the numerical data is obtained if one uses 
C(t,t w ) « f(h(t)/h(t w )) with h(t) = exp(i 1 -^/(l - fj,)) 
and n slightly larger than 1 (see Refs. [51,23] for a pre- 
cise analysis where longer waiting-times have been used 
and the approach to the plateau has been taken into ac- 
count). In what follows, to keep the analysis of the data 
as simple as possible, we adopt the simpler power law 
expression for hit). 
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FIG. 9. Decay of the global correlation C(t,t w ) in the 3d 
EA model as a function of (t — t w )/t m . The waiting-times are 
indicated in the key. T = 0.7 and L — 32. 



B. Relation to random surfaces 



IV. SCALING OF LOCAL CORRELATIONS 

After having introduced the local two-time quantities 
in Sec. II and having discussed several scenarios for their 
behavior in Sec. Ill, in this section we study the dynamic 
behavior of the coarse-grained and noise-averaged local 
correlations of the 3d EA model using numerical simula- 
tions. 

A. Global correlation 

We recall that, for the waiting and total times we 
use, the aging decay of the global correlation [Eq. (3)] 
is rather well described with a simple t/t w scaling [51]. 
Indeed, even without subtracting the first approach to 
the plateau at g EA (that can occur with a very slow power 
law [21]) the scaling is quite acceptable. To illustrate this 
point, we show the global correlation against (t — t w )/t w 
in Fig. 9 for a system evolved with a single thermal his- 
tory and using relatively short waiting-times. 

We stress that we do not claim that this scaling holds 
asymptotically. It simply approximately describes the 



The evaluation of the local correlations on the d- 
dimensional real-space substrate allowed us to draw a 
parallel between the evolution of the local coarse-grained 
correlations and the dynamics of a d-dimensional ran- 
dom surface [34], see Sec. HID. At any pair of times 
(t,t w ) the random surface fluctuates about the global 
value C(t,t w ) and it is constrained to do so between — 1 
and 1 since Ci £ [—1,1]. Within our RpG invariant the- 
ory, there is a one-to-one relationship between this ran- 
dom surface for the coarse-grained correlator C cg (f; t, t w ) 
and the random surfaces <f>(r,t) (and (f>(r,t w )) discussed 
in Sec. HID, as evident from the relation Eq. (56). The 
parallel between the evolution of the local correlations 
and the dynamics of a d-dimensional random surface can 
also be extended to the noise-averaged correlations (al- 
though we present no analytical theory for this case). 

The statistical and dynamical properties of the surfaces 
in each case are not necessarily the same. In Figs. 10 and 
11 we show the values of the local coarse-grained and 
noise-averaged correlations, respectively, on a 2d cut of 
the 3d real space. These figures illustrate how the local 
correlations generate a surface with height Cj on each 
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site i of the 3d substrate. The statistical properties of 
the Ci (their distribution, geometric organization, etc.) 
inform us about the statistical properties of the random 
surface. Similarly, we can think about the random sur- 
face generated by the coarse-grained and noise-averaged 
local susceptibilities. In Sec. IX we shall show the results 
of the numerical analysis of the geometric properties of 
the random surface of local correlations in the 2d and 3d 
EA models. 
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10. Surface of local coarse-grained correlations on a 



2d cut of the 3d real space. T = 0.8, L = 64, M = 3. The local 
correlations are evaluated at t w = 4.1 x 10 5 and t = 2.8 x 10 6 , 
i.e. t/t w ~ 6.8. 
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FIG. 11. Surface of local noise-averaged correlations on a 
2d cut of the 3d real space. T — 0.7, L — 32, 10 3 noises. 
The local correlations are evaluated at t w = 1.6 x 10 4 and 
t = 4.8 x 10 4 , i.e. t/tw = 3. The fluctuations are reduced 
with respect to the ones in Fig. 10 since T is lower and t/t w 
is smaller here. Note that this surface fluctuates between 
and 1 since the noise-averaging eliminates negative values. 



C. Coarse-graining volume 

Before analyzing the time dependence of the local 
correlations we briefly exhibit the dependence of the 



coarse-grained correlations on the coarse-graining vol- 
ume. In Fig. 12 we plot C^ 9 (t,t w ) against the time- 
difference t — t w on seven sites around the site with co- 
ordinates (1,1,1), using three coarse-graining volumes 
V = (2M + l) 3 with M = 3,6,9. The waiting-time is 
t w = 500 MCs. As expected, coarse-graining smoothens 
the spatial variation of the local correlations and we see 
very little variation between the local correlations on 
neighboring sites. For t w — 500 MCs, the curves for 
M = 3 are rather noisy while those for M — 6 and M = 9 
behave roughly in the same way. For longer waiting-times 
the curves for the three coarse-graining volumes behave 
roughly in the same manner (not shown). In what fol- 
lows we shall typically use M = 1, M = 3 and M = 6 
that correspond to linear sizes 2M + 1 = 3, 2 M + 1 = 7 
and 2M + 1 = 13. The first choice is the coarse-graining 
implicit in the analytic theory (see Eqs. (35) and (36), 
except that here the central site is also included). The 
two latter choices are of the order of one fifth of the linear 
size of the system if L = 32 and L = 64, respectively. 
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FIG. 12. The local correlation C^ g {t,t w ) against t — t w for 
t w — 500 MCs. L = 64. The three groups of curves correspond 
to coarse graining volumes V — (2M + l) s with M = 3,6,9. 
Different curves within each group correspond to the 7 sites in 
the cubic box centered on the site with coordinates (1, 1, 1). 
We use a variable coarse-graining time r that starts at r = 10 
MCs and is multiplied by 5 each time the total time reaches 
500 x 5 fc with k = 1, . . . For comparison we also plot the global 
correlation C. 



D. Distribution functions 

What is the origin of the rather simple scaling of the 
global correlation for the times explored? Do all local 
correlations scale in the same way, and as ~ t/t w , or is the 
global scaling the result of the combination of different 
behaviors on different sites? 

In order to explore these questions we first study the 
time-evolution of the probability distribution function 
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(pdf) of local correlations. In Fig. 13 we show the distri- 
bution of C" a 's for several pairs of t and t w with ratios 
given in the key. Only one disorder realization has been 
used and the curves are drawn with correlations that have 
been averaged over 10 3 realizations of the noise. The full 
distributions scale approximately with t/t w . The peak 
moves towards smaller values of C™ a when the ratio in- 
creases (c/r. Fig. 15) and the distribution gets slightly 
wider. The curves with wider lines correspond to the 
longest t w . For small t/t w a drift with increasing t w 
leading to a very mild decrease in the height of the peak 
is visible in the figure. Note that when sufficiently many 
noise realizations are averaged over, the distribution does 
not have any weight on negative values of C" a . For even 
larger values of the ratio t/t w we expect to see a reverse 
trend in the sense that the distribution has to start get- 
ting squeezed around the value Cf a = 0. 




FIG. 13. The distribution of the noise- averaged local cor- 
relations C" a for several pairs of t and t w . The waiting-times 
are t w = 10 3 MCs, 2 x 10 3 MCs, 4 x 10 3 MCs, 8 x 10 3 MCs, 
1.6 x 10 4 MCs, and 3.2 x 10 4 MCs, and the ratios t/t w are 
indicated in the key. We averaged over 10 3 realizations of the 
noise. r t = t/10, L = 64 and T = 0.7. 

The central part of the distribution is described very 
well by a Gaussian distribution for intermediate values of 
t/t w (before the PDF starts to be squeezed on C" a = 0). 
Indeed, Fig. 14 shows two Gaussian fits to the numeri- 
cal PDFs for the ratios t/t w — 8, 16 and t w — 3.2 x 10 4 . 
Note that since Cf a £ [0, 1] the Gaussian fit cannot be 
perfect. In Sec. IV B we mentioned the interpretation of 
the local correlations as generating a random surface on 
the 3<i substrate. The approximate Gaussian distribu- 
tion of the Cf a implies that we can interpret the random 
surface of noise-averaged correlations as being approxi- 
mately Gaussian. 

The distribution seems to become stable with respect 
to the number of realizations of the noise, after a large 



enough number of such realizations. More precisely, we 
do not see any noticeable variation between the calcu- 
lated distributions that are averaged over 500 and 1000 
thermal histories. We expect this distribution to be 
self-averaging, i.e., independent of the particular realiza- 
tion of the disorder for large enough systems. We have 
checked the self-averaging property numerically, and also 
that, for large enough values of N, the distribution be- 
comes size independent. 
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FIG. 14. The distribution of the noise- averaged local corre- 
lations C" a for two ratios t/t w given in the key, t w = 3.2x 10 4 , 
and two Gaussian fits. Same parameters as in Fig. 13. 




FIG. 15. The distribution of the coarse-grained local cor- 
relations Cl 9 for several pairs of t and t w . M = 0, 
[2M + 1 = 1 < L = 32, t = 10 3 mcs and T = 0.8. 

The parameters given in the key determine the waiting-times, 



t — T 



X 10 MCS. 



Figure 13 should be compared to Figs. 15-17 in which 
the distribution of the coarse-grained local correlations, 
Cf 9 , is shown for several times and different values of the 
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coarse-graining volume. 

In Fig. 15 the coarse-graining volume has a linear size 
2M+1 = 1. Thus, there is no spatial coarse-graining and 
the only reason why these curves are not simple peaks at 
— 1 and 1 is that the coarse-graining in time, done with 
r t = 10 3 MCs for all times, slightly smooths the data. 

In Fig. 16 the coarse-graining volume has a linear size 
2M +1 = 3. This distance is slightly shorter than the 
two-time dependent correlation length, £(t,t w ), that we 
shall define and study in Sec. V. For this amount of 
coarse-graining the PDF has a nice scaling behavior. The 
position of the peak is almost independent of the ratio 
t/t w in this case. Its height diminishes when the ratio 
t/t w increases and the tail at smaller values of C C9 grows. 
The scaling with t/t w is rather good in this case. 
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FIG. 16. The distribution of the coarse-grained local cor- 
relations CI 3 for several pairs of t and t m . M = 1 
[2M + 1 = 3 ~ £(t,t w )], L = 32, t = 10 3 MCs and T = 0.8. 
The parameters in the key fix the waiting-times as in Fig. 15. 

Finally, in Fig. 17 the coarse-graining volume has a lin- 
ear size 2M+1 = 13 which is almost half the system size 
and much larger than the two-time dependent correlation 
length £(t, t w ) for all the waiting and total times studied. 
The width of the PDFs has been considerably reduced 
with respect to the previous case. In particular, the PDF 
does not have any weight on negative values, as opposed 
to what is shown in Fig. 16. It has also become quite 
symmetric, centered at the global value which is also ap- 
proximately the average value of this PDF. Reasonably, 
the distributions drift towards smaller values of the cor- 
relations when the value of t/t w increases. Moreover, the 
scaling with t/t w worsens with too much coarse-graining, 
as is to be expected. Using such a large coarse-graining 
volume one approaches the limit in which the distribu- 
tion becomes a delta-function at the global value. The 
t/t w scaling is only an approximation to the true scaling, 
see Fig. 9. In order to improve the fit one should elim- 
inate the contributions to the stationary decay but this 



is not easy to do at the level of the full distribution. 
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FIG. 17. The distribution of the coarse-grained local cor- 
relations C'l 3 for several pairs of t and t w . M = 6 
[2M + 1 > £(t,i«,)], L = 32, r = 10 3 MCs and T = 0.8. 
The parameters in the key fix the waiting-times as in Fig. 15. 

It is clear that for a given disorder and thermal his- 
tory this distribution approaches a delta function on the 
time-dependent global value of the correlation when the 
coarse-graining volume reaches the size of the system. 
Even in this limit, for finite N we still have sample-to- 
sample and noise-to-noise fluctuations and hence a non- 
trivial distribution of these points. 

To conclude, the noise-averaged PDF and the coarse- 
grained PDF approximately scale with t/t w for long 
waiting-times when 2M + 1 <~ t w ). However, even 
if for a given ratio t/t w the mean of the distributions co- 
incides (yielding the global value in both cases), the form 
of the two PDFs differs at equal t/t w . This is most clearly 
seen by comparing, for instance, the curves for t/t w = 32 
in Figs. 13 and 16. The most distinctive difference is 
given by the persistence of a peak in p(C cg ) that is cen- 
tered on a stable value (although its height decreases with 
increasing t/t w ). Moreover, the PDF of noise-averaged 
correlations is approximately Gaussian for intermediate 
t/t w values while the PDF of coarse-grained two-time lo- 
cal correlations is not when 2M+ 1 <~ t w ). For larger 
values of the linear size of the coarse-graining volume the 
PDF looks more Gaussian, see Fig. 17, at least in its cen- 
tral part. We have observed the same features at other 
temperatures. 

We end this subsection by pointing out that the proba- 
bility distributions for noise-averaged and coarse-grained 
quantities can be interpreted as, respectively, probabil- 
ities of averages and averages of probabilities. To see 
this relation, consider a quantity that is noise averaged 
after being coarse grained, and its probability density 
is p((C^ 9 )). In the limit when the coarse graining vol- 
ume is a single spin (M = 0), we recover p{Cf a ), us- 
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ing C™° = (Ci). Now, for a large enough total system 
size, the probability distribution for coarse-grained quan- 
tities p(C^ 9 ) becomes self-averaging, p(C^ 9 ) — > (p{C^ 9 )). 
Hence, the differences between the noise-averaged and 
coarse-grained probabilities derive from the fact that 

pm 9 ))^( P {ct 9 )). 



E. Scaling of noise-averaged local correlators 

We have just shown that the even if the probability dis- 
tributions of noise-averaged and coarse-grained local cor- 
relations take different forms, they scale approximately 
as t/t w . This does not mean, however, that each site has 
a local correlation scaling with t/t w . Equations (17) and 
(18) can now be put to the test by studying the decay in 
time of the individual local correlations C" a and C C9 '. 

A simple way to test Eq. (17) is to plot the values of 
the local correlations at different sites for different pairs 
(t, t w ) such that their ratio, t/t w , is held fixed. If the hy- 
pothesis is correct, for a given site, its correlation must 
take a very similar value for all t w 's. Figure 18 shows this 
test for a 3d EA model of linear size L = 32 at T = 0.7. 
The average involves 10 3 noise realizations. In the three 
panels we used different values of the ratio t/t w as la- 
belled. The points represent the values of the noise aver- 
aged local correlations at sites in four rows in the cube. 
More precisely, the discrete points on the axis labelled 
"site" correspond to (x — 0,y — 0,z = 0, ...,L— 1), 
(x = 0,y = l,z = 0, . . . , L - 1), (x = 0,y = 2, z = 
0, . . . , L — 1) and (x = 0, y = 3, z = 0, . . . , L — 1) ordered 
in this way. This means that, for example, the values 
site = 0, site = 32 and site = 64 are nearby sites on 
the lattice, site = being (x — 0, y — 0, z — 0), site 
= 32 being (x = 0,y = l,z = 0) and site = 64 being 
(x = 0, y = 2, z = 0). This explains the approximate pe- 
riodicity in the data: it indicates that nearby sites have a 
rather similar behavior as most clearly indicated by star- 
ing at the points with rather small values of C" a . The 
lines are added as guides to the eye. The figure shows 
that the noise averaged correlations satisfy the hypothe- 
sis in Eq. (17) for this range of times. The site-dependent 
external function fa in Eq. (17) reflects the fingerprint of 
disorder. 

Interestingly enough, even running at different tem- 
peratures (with the same seeds for the thermal noise) 
the individual evolution of the sites is still very similar 
(see Fig. 19). This issue deserves further investigation 
since it might be very useful in helping to explain the 
intriguing memory and rejuvenation effects seen in the 
dynamics of spin-glasses when temperature is modified. 
Nevertheless, we shall not expand on this topic here. 
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FIG. 18. The fingerprint of disorder. The noise- averaged 
local correlation on 128 sites ordered along four adjacent rows 
for three choices of the ratio t/t w indicated as a label in each 
panel. L = 32, T = 0.7, Tt = t/10. The curves for different 
tu,'s fall on top of each other showing that C™ scales as in 
Eq. (17). 
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FIG. 19. Competition between temperature and quenched 
disorder. The noise- averaged local correlation on adjacent 128 
sites for two temperatures, T — 0.56 and T = 0.7. The time 
ratio is t/t w = 1.4, t w = 8 x 10 3 MCs and r t = t/10. The two 
sets of data are surprisingly similar. 



F. Scaling of coarse-grained local correlators 

We can now analyze the coarse-grained local correla- 
tions in the same manner as the noise-averaged ones. 

First, in Fig. 20 we show C^ 9 on 128 sites chosen as in 
Fig. 18 (see the text above) for three choices of t/t w — 
2, 4, and 64 at t w = 10 3 MCs. The coarse-graining volume 
is small, M = 1. The curves for different t^'s do not scale 
exactly since the noise induces fluctuations in addition 
to those that originate from the quenched disorder. C 4 Cff 
does not scale as in Eq. (17) for any of the choices of the 
ratio t/t w . 
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FIG. 20. Test of t/t w scaling in the coarse-grained correla- 
tion. Values of this quantity on 128 adjacent sites for three 
choices of the ratio t/t w indicated in each panel. M = 1, 
L = 32, T = 0.8, and Tt = t/10. 

Notice that the curves obtained for different pairs of 
time (t, t w ), even though the ratio t/t w is fixed, cross each 
other at many points. Therefore, it is always possible to 
find sites i and j at opposite sides of the crossing points 
for which C- 9 > Cf for one pair of (i, t w ), but C C9 < Cf 
for another. In other words, the relative age (as measured 
using the correlation value) between two sites i and j in 
the sample is not static, but fluctuates as a function of 
time. These are exactly the sorpassi that we described in 
Sec. HE. Once again, notice that this is in sharp contrast 
with the scaling Eq. (17), where the relative age between 
all sites in the sample keeps a constant, static, relative 
rank. 

In Fig. 21 we compare the coarse-grained and noise- 
averaged local correlations for two systems with the same 
quenched disorder, evolved at the same temperature. We 
plot the local correlations on one row of the 3c? cube cor- 
responding to (x — 0,2/ = 0, z = 0,...,L— 1), with 
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L = 32. The temperature is T = 0.7. In all panels we 
plot the noise-averaged data for three t w 's, t w = 8 X 10 3 
MCs, 1.6 x 10 4 MCs and 3.2 x 10 4 MCs, with crosses 
and the coarse-grained data, for the same waiting-times, 
with open squares [t w — 8 x 10 3 MCs), open circles 
(t w = 1.6 x 10 4 MCs) and dark squares (t w — 3.2 x 10 4 
MCs). The lines joining the points are a guide to the eye. 
The ratio between t and t w is always t/t w = 1.4 but sim- 
ilar results are obtained for other choices. In different 
panels in the figure we use different values of M, M = 
(a), M = 1 (b), M = 3 (c), and M = 5 (d). 

The first result from these figures is that, as already 
shown in Fig. 18, the noise-averaged data scale as in 
Eq. (17). Instead, the coarse-grained data do not scale 
in this way for any of the values of M. 

Let us now discuss in detail the effect of coarse- 
graining. In panel a) we compare the noise-averaged 
data to the results of a single run without coarse-graining 
(M = 0). We see that the t/t w scaling does not hold for 
the curves with coarse-grained data, but the values of 
the local correlations are very much influenced by the 
disorder. For instance, observe the low values simultane- 
ously taken by the correlation at site= 10 for the noise- 
averaged quantity and also in the single thermal history 
runs. 

In panel b) we use a minimum volume V = (2M+1) 3 = 
3 3 . We see that the "surface" created by the coarse- 
grained data has been smoothed with respect to the case 
M = shown in panel a) but there remains a memory of 
the underlying quenched disorder. The coarse-graining 
does not help improve the t/t w scaling. 

This trend is even clearer in panels c) and d) where we 
use M = 3 and M = 5, respectively. The t/t w scaling 
is clearly broken as the surfaces become smoother and 
smoother when M increases. When M = 5 the surface 
is almost totally flat and the fingerprint of disorder has 
been washed out by coarse-graining. However, there are 
still soft local fluctuations that break the t/t w scaling. 

The conclusion we draw from these plots, and from 
the theoretical discussion in Sec. Ill, is that for a truly 
infinite system, N = L 3 — > oo, we expect to find that 
when times diverge, t, t w oo with C(t,t w ) fixed to a 
chosen value, say C(t, t w ) = C, thus selecting the correla- 
tion scale, coarse-graining over a sufficiently large volume 
erases the fingerprint of disorder whilst still allowing for 
fluctuations that change the reparametrization locally, 
h(t) — > hi(t) = h(t) +Shi(t). This argument implies that 
hypothesis (18) should describe the data in this limit. In 
Sec. V we shall further discuss the implications of coarse- 
graining. 

The final test of this hypothesis would be to plot the 
value of the correlation on each site for different pairs of 
times such that hi(t)/hi(t w ) is held fixed. If the hypoth- 
esis in Eq. (18) holds, the surface of the resulting figure 
should be flat. 
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FIG. 21. Comparison between noise- averaged 
and coarse-grained local correlations. The three curves in 
each group correspond to three waiting-times. t w = 8 x 10 3 
MCs (open squares), t w — 1.6 x 10 4 mcs (open circles) and 
t w = 3.2 x 10 4 MCs (filled squares) for the coarse-grained 
data. The coarse-graining volume is indicated in the labels. 
L = 32, T = 0.7. The coarse-graining times is r = 8 x 10 2 
MCs when t w — 8 x 10 3 MCs and is multiplied by 2 when the 
time is doubled. 

An equivalent way to check hypothesis (18) is to plot 
the decay of the local correlations on several sites, for 
several chosen values of t w and all subsequent t, against 
different ratios Xi = hi(t)/hi(t w ). For each site i the 
choice of an adequate scaling function hi{t) should lead 
to a collapse of each of the local correlations Cj(i, t w ) cor- 
responding to different t w 's. Moreover, if the (in principle 
site-dependent) master curves, fi, thus obtained are all 
identical, fi — f for all i, then the conjecture in Eq. (18) 
is satisfied. 

The careful implementation of these checks is rather 
tedious since one needs an independent inspection of the 
dynamics of each site in the sample. Wc take the flat- 
tening of the curves in Fig. 21 for increasing M as strong 
evidence for the scaling in Eq. (18) in the "scaling limit" 
defined in Sec. VB. 



G. Effect of coarse-graining on already 
noise-averaged quantities 

In Fig. 22 we coarse-grain the already noise-averaged 
data for the local correlation. When M = 3 the surface 
is already quite flat (and t/t w dependent). This is to 
be compared with the the data in Fig. 21c) for one run 
coarse-grained over the same volume. We see how the 
fingerprint of disorder progressively disappears with more 
coarse- graining. 




FIG. 22. Effect of coarse-graining on the local noise 
aged data. The parameters are as in Fig. 21 



V. TWO-TIME DEPENDENT CORRELATION 
LENGTH 

In this section we define a correlation length from the 
study of the spatial fluctuations of the two-time local 
correlators. We also discuss the interplay between times 
and length-scales in the analysis of our data. 



A. Definition 

The presence of a Goldstone mode in the dynamics 
gives rise to a specific form for the spatial correlations of 
the fluctuating two-time fields Q^(t,t w ). In the asymp- 
totic limit, the RpG invariance implies a true Goldstone, 
or zero mass, mode. Therefore, the spatial correlations 
in the fluctuations should show a power law decay ~ 1/r 
in 3d. However, as mentioned before, we know that for 
any finite time, the RpG invariance is explicitly broken 
by irrelevant terms that play the role of symmetry break- 
ing fields. As in the case of magnons in the presence of 
a weak external magnetic field, the Goldstone mode in 
the dynamics acquires a small mass, which vanishes in 
the asymptotic limit of small symmetry breaking field, 
i.e. in the long time limit. Therefore, wc expect that in 
a simulation, the local two-time quantities will exhibit a 
finite correlation length for their fluctuations. Fixing the 
relation between t and t w to have, say, a given global cor- 
relation, one should find a correlation length £(i, t w ) that 
increases monotonically for increasing t w . Equivalently, 
the mass m(t, t w ) = l/£(i, t w ) should be a monotonically 
decreasing function of the times [66] . 

Most of the results about the finite correlation length 
that we present were obtained for a 3d EA model with 
linear size L — 32 evolving at T = 0.8. We considered 64 
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realizations of the disorder. The length of the simulation 
was 8.192 x 10 7 mcs. 

The two-time quantities considered are the local two- 
time correlations C^^tJ) = Ci(t,t w ) = Si(t)sj (t w ), 
where the Si(t) are site magnetizations time averaged 
over r = 10 3 MCs. The vector fi is the position of site i 
with respect to a chosen origin of coordinates. 

We define a spatial correlator 



A(r; t,t w ) = 



(63) 



that is averaged over disorder realizations but is not av- 
eraged over the noise. Since the problem is isotropic on 
average we expect the r.h.s. to depend only on the mod- 
ulus of the distance between the positions of the spins 
considered, r = \r\. Thus we write r in the argument of 
A. N — L 3 is the total number of spins in the sample. 
As r — > oo we expect that this correlator will approach 
its disconnected part: 



Aoc(t,t w ) = lim A(r;t,t w ) 

r — >oo 

= [C(t,t w ) 2 } , 



(64) 



with C(t,t w ) the global correlation. 

In order to define a correlator that has a spatially 
asymptotic value that is independent of the times t and 
t w we define the normalized correlator: 



A(r; t, t w ) 



A(r; t, t w ) 

Aqo {p: t w ) 



(65) 



which tends to unity in the limit r — > oo. Therefore, the 
connected part of A is simply A—l. Note that the equal 
site correlator A(r = 0; t, t w ) is very close to 1/A 00 (t, t w ) 
since the zero-distance correlator, A(r — 0,t,t w ), in- 
volves Si 2 (t) and ~s 2 (t w ) that for short coarse-graining 
times t and long times t and t w are approximately equal 
to 1. For any t w the denominator Ao^t, t w ) — [C(t, t w ) 2 ] 
vanishes in the limit t > Consequently, as it is de- 
fined, the correlator A(r;t, t w ) evaluated at zero spatial 
distance diverges with increasing t for any value of t w . 
At equal times A is approximately 1 for all distances r; 
the reason for this result is again the fact that Si 2 (t) w 1. 

One can also define a correlator that is forced to evolve, 
for all pairs of times t and t w , between 1 at zero distance 
and for infinitely separated distances. Indeed, 



B(r;t,t v 



A(r; t,t w ) — Aqv (t, t w ) 



A(r — 0; t, t w ) — (t, t w ) 
satisfies these requirements. 



(66) 
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FIG. 23. Spatial correlations B(r;t,t w ) against distance r 
for t w = 10 4 MCs and t/t w = 2, 16, 128, 1024, and 8192. 

In Fig. 23, we show the space dependence of B(r; t,t w ), 
for various ratios t/t w . In all cases we observe that the 
correlation decays rapidly, consistent with an exponential 
decay, for r < 6 lattice spacings. To make this more 
apparent, we show a semilog plot for the same t/t w ratios 
in Fig. 24. 
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FIG. 24. Spatial correlations B(r;t,t w ) against distance r 
in a semi-logartihmic scale for t w — 10 4 MCs and t/t w — 2, 
16, 128, 1024, and 8192. 

In the previous two figures, the horizontal axis repre- 
sents the distance r. One point is plotted for each vector 
r, therefore many points with similar r but correspond- 
ing to different directions for r appear close to each other. 
The fact that in the figures the corresponding values of 
B are also close together indicates that the spatial cor- 
relations are indeed spatially isotropic, as expected. 
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FIG. 25. Comparison between the spatial dependence of 
B(r;t,t w ) for L = 32 and L = 64, with t w = 10 4 MCs and 
if tw 2. 

In Fig. 25, we show the decay of the correlation for 
two system sizes L = 32 and L — 64. We observe that 
the decay is roughly independent of the system size, up 
to distances of the order of r ~ 6. One notices that the 
trend of the points, after this limit, is to bend downwards 
for L — 32 and to bend upwards for L — 64. r ~ 6 is also 
the distance upto which the exponential fit [see Eq. (67) 
and Fig. 26] is very good. (In this figure, t w — 10 4 MCs 
and t/tw = 2.) 
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FIG. 26. Example of fit with an exponentially decaying 
function given in Eq. (67) and a Yukawa type of correlator 
in 3d given in Eq. (68) (see the text for details). The data 
correspond to t w = 3.2 x 10 5 MCs, t = 2.56 x 10 6 MCs. The 
data were fitted in the interval r £ [1.5, 6.0]. 

In Fig. 26, we show a typical example of a fit of the cor- 
relation to exponentially decaying functions. Two possi- 
ble fits are displayed, one with the simple exponential 
form 



(67) 



the other with the Yukawa form 



SYuk(r; t, t w ) = D(t, t v 



-m(t,t w ) r 



(68) 



The second form is the 3-dimensional Fourier transform 
of the massive correlator l/(k 2 + m 2 ), and one would 
naively expect this form to provide the best fit. How- 
ever, on deeper examination, it is necessary to take into 
account the form of the fluctuations, as discussed in 
Sec HID (see Eq. 56), and in particular the fact that 
C(r,t,t w ) appears to depend exponentially on the two 
fluctuating fields (f>(f,ti) (t{ = t,t w ). Since the fluctu- 
ations in C(r,t,t w ) are significant, even if the propaga- 
tor for each reparametrization fields 4>(r,ti) had a sim- 
ple Yukawa form, the form of B(r;t,t w ) is in principle 
highly nontrivial, and in particular the value of the mass 
m(t,t w ) is not easy to predict. 
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FIG. 27. Dependence of the fitted values of the mass on 
the interval chosen for the fit. Comparison between values 
of the mass obtained by fitting in the intervals r £ [0.0,4.0], 
r £ [1.5, 5.1], and r £ [2.5, 7.1], displayed as a function of t w . 
In all cases, L = 32, and t/t w —2. 

For the range of times and system sizes achieved in our 
simulations, it turns out that both the simple exponential 
and the Yukawa forms provide good fits for intermediate 
values of r, but the first one consistently has a better 
X 2 , and it consistently provides a better extrapolation 
outside the fitting interval. For larger values of r, finite 
size effects seem to play an important role, producing an 
even steeper decay of the correlations. In principle there 
is no reason to expect the fit to be good for small values 
of r. However, the simple exponential form actually does 
provide a good fit down to r = 0. In what follows, all the 
values of the mass (equivalently, the inverse correlation 
length) are obtained by using a simple exponential fit in 
the interval [0, 4]. Each fit has 52 degrees of freedom, and 
typical x 2 per degree of freedom are of the order of 10~ 3 . 
From the definition in Eq. (66), we know that B(r = 
0;t,t w ) = 1. The fitting functions that we use do not 
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need to have exactly this value at the origin, but it turns 
out that, for the simple exponential form, D{t,t w ) « 1 
within an error of the order of 10 %. 

Figure 27 displays a comparison of results obtained 
by using different fitting intervals. Changing the fitting 
interval does somewhat affect the results of the fits, but 
the trends are consistent, and the interval chosen (r E 
[0.0,4.0]) seems to be the one that minimizes the noise 
in the mass versus time curve. 
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FIG. 28. Mass (inverse correlation length) as a function of 
the waiting-time. Each set of points corresponds to a fixed 
ratio t/t w . The horizontal axis corresponds to l/lnt m . 



CD 



0.8 



t/t„ 



t/t w = 2 
t/t w = 16 

:/t,„= 128 
1024 



« 0.6 



0.4 



0.2 



0.1 



0.2 



0.3 



0.4 



0.5 



FIG. 29. Mass (inverse correlation length) as a function of 
the waiting-time. Each set of points corresponds to a fixed 
ratio t/t w . The horizontal axis corresponds to t w ~ a with 
a = 0.085. 

In Figs. 28 and 29, we show the two-time dependence 
of the mass in our simulations. Each set of points cor- 
responds to a fixed ratio t/t w . We attempt two fits of 
the mass as a function of t w . In Fig. 28 we show the fit 
m(t,t w ) = l/^(t,t w ) w m (t/t w )/lnt w . In Fig. 29, we 
show the fit rn(t,t w ) = l/£(t,t w ) « m (t/t w )(t w /t )^ a , 



with a = 0.085. The simulation results are consistent 
with both fitting forms. Due to the very slow decay of 
the mass with t w , it is not possible to distinguish between 
the two fits. Another important feature of the data is re- 
vealed by these figures: the correlation length increases 
with increasing ratio t/t w , at fixed t w . One must note, 
though, that the variation of the mass with the ratio t/t w 
is also quite mild. 

An intriguing fact in our results is that the values of 
the correlation length obtained are extremely short. Note 
that Figs. 28 and 29 show a variation of the mass between 
0.4 and 0.8 that corresponds to lengths between 1.25 and 
2.5 lattice spacings. As shown in Fig. 30 these values 
change quite a bit if one uses instead a fitting procedure 
with the Yukawa form in Eq. (68). As mentioned before, 
the simple exponential form provides a better fit for the 
range of distances accessible in our simulations. However, 
this conclusion might in principle change if much larger 
sizes were simulated. (See, e.g. Fig. 25, where the data 
for L = 64 seem to deviate above the simple exponential 
fit for longer distances, which would be consistent with 
a different functional form for B and possibly a smaller 
value of the mass.) The big difference in the mass values 
for the two fits indicates that any quantitative results 
about the precise value of the mass have to be taken with 
caution, and that our conclusions should be restricted 
to indicate general trends in the data. Based on these 
considerations we shall postulate, somewhat arbitrarily, 
that the correlation lengths for the times explored in the 
rest of this paper are in between the two fits and of the 
order of 3 to 5 lattice spacings. 
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FIG. 30. Comparison between the values of the masses ob- 
tained with the exponential fit given in Eq. (67) and the fit 
with the Yukawa form given in Eq. (68) . In both cases L = 32, 
t/tw — 2. 

Let us discuss a qualitative picture for describing the 
two-time dependence of the m(t,t w ) suggested by the 
random surface action of Sec. HID. Although m(t,t w ) 
depends on the two times t and t w , an action such as 
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that in Eq. (58) (with an added r-dependent mass term) 
suggests that different time siices factorize in the effec- 
tive theory for fluctuations. This picture is onfy approx- 
imate, in that for time ratios not far from one, the sub- 
leading terms neglected in Eq. (58) will generate correc- 
tions. Thus we expect that, for long times and large 
t/t w ratios, m(t,t w ) should be some kind of average of 
one-time quantities associated with t and t w . This pic- 
ture suggests that one should also analyze the correlation 
length data by plotting it against an average between t 
and t w , the appropriate one being a geometric average 
tave — y/tt w [which corresponds to the simple average 
i~ave = (t + t w )/2 for the proper times, where r = lni]. 
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FIG. 31. Mass (inverse correlation length) as a function of 
the geometric average between t and tw Each set of points 
corresponds to a fixed ratio t/t w . The horizontal axis corre- 
sponds to In (it™). 
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FIG. 32. Mass (inverse correlation length) as a function of 
the geometric average between t and t w . Each set of points 
corresponds to a fixed ratio t/t w . The horizontal axis corre- 
sponds to l/\n(tt w ). 

With the above picture in mind, we now re-analyze the 



data in our simulations by replotting the mass m(t,t w ) 
as a function of tt w in Fig. 31. 

As Fig. 31 shows, the curves for fixed t/t w ratio even- 
tually converge to an asymptotic curve for large t/t w . 
As discussed above, this is consistent with the sublead- 
ing corrections in Eq. (58) becoming negligible for large 
t/t w ratios. In Figs. 32 and 33 we attempt to obtain 
more detailed information about the time dependence of 
the mass. In Fig. 32 we show fits of m(t, t w ) = l/£(t, t w ) 
to a 1/ In (ft,,,) dependence. If a nonzero value is allowed 
for the mass at infinite time, the fitted value obtained is 
negative, meaning that the mass actually goes to zero at 
very large, but finite, times (tt w ~ 10 276 ). In practice, 
this fit is as good as a fit with the mass going to zero only 
at infinite time: in both cases x 2 per degree of freedom 
is of order 10~ 4 . 

In Fig. 33 we show the fit m(t,t w ) = l/£(t,t w ) to a 
power law {tt w /tf ) )~ a . If a finite mass is allowed at infi- 
nite times, an exponent a w 0.10 is obtained. If, instead, 
the value of the mass is assumed to be zero at infinite 
times, a « 0.04 is obtained. The \ 2 P er degree of free- 
dom is again of the order of 10 -4 for both fits. 
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FIG. 33. Mass (inverse correlation length) as a function of 
the geometric average between i and t w . Each set of points 
corresponds to a fixed ratio t/t w . The horizontal axis corre- 
sponds to (tt w )~ a with a = 0.04. 

In summary, the simulation results indicate that (i) 
m(t,t w ) is asymptotically (for large t, t w and t/t w ) only 
a function of tt w ; (ii) m(t, t w ) is a very slow monotonous 
decreasing function of tt w , consistent both with the m rj 
\/\n(tt w ) and with the m w (tt w /t^)~ a functional forms; 
(iii) the values of the correlation length £ = 1/m are of 
the order of only a few lattice constants for the timescales 
accessible in the simulations; (iv) the extrapolation of the 
data fits is consistent with the expected m — > behav- 
ior for long times, but a nonzero mass at infinite times 
cannot be excluded. 

Previous studies [24,67] have found a correlation 
lengthscale £(t w ) growing with t w that is in the range of 
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3 to 4 lattice spacings for the waiting times and tempera- 
tures we have considered. Those authors determined the 
correlation length from the spatial decay of a four point 
correlation function [67] 

N 1 2i„-l 

G(r,t w ) = -J2 r E m^T)C$ +f {r))] , (69) 

with C2 b (r) = Sp.( T ) s f-( T )^ involving thus two copies of 
the system a and b, with identical exchanges, and an av- 
erage over thermal histories and disorder. Note that this 
"2-point correlator" differs from ours in that (i) it is eval- 
uated at equal times, (ii) there is a further average over 
the noise, and, more importantly, (iii) the two-point func- 
tions that one further correlates are evaluated between 
two copies of the system evolving independently. The 
latter property implies that this length can only be tested 
experimentally with indirect measurements [23,68]. In- 
teresting enough, the length we define in this paper is, 
in principle, accessible directly with local experimental 
probes. Even if representing different quantities the val- 
ues reached by the two correlation-lengths are very short 
and very similar. 

B. Interplay between the waiting-time, linear 
coarse-graining size and correlation-length 

In this section we discuss the role played by the wait- 
ing and total times, t w and t, the coarse-graining linear 
size, 2M + 1, and the correlation length, t;(t,t w ), in our 
measurements. We assume that the size of the system, 
L, is the largest scale in the problem that has diverged 
at the outset of the discussion. 

For a finite but very long waiting-time, t w \, and a 
time-window on which one wishes to study the 

fluctuating dynamics, the correlation length, £(ii, t w i) is 
finite but very long. Choosing a cubic coarse-graining 
volume V\ with linear size 2M\ + 1 < £(t\ , t w \) one 
then accommodates [£(ti, t u , 1 )/(2M 1 + l)] d cells within 
each correlated volume [£(ti, t wl )] d . According to the 
discussions in previous sections, the local coarse-grained 
two-time functions, defined on each cell, have different 
time-reparametrizations, hi(t), that vary smoothly in 
real space until reaching the correlation length, £(ti, t w i), 
when they completely decorrelate. By taking a large 
coarse-graining volume we ensure that the underlying ef- 
fect of disorder is erased. This kills the fluctuations in 
the external function /j, [see Eq. (16)] as well as erasing 
all fluctuations in q\ A . The fluctuations in the local time- 
reparametrizations give rise to a distribution of values of 
the local coarse-grained correlations, p(C^ 9 (ti, t wl j) that 
we study numerically in Sec. IV. 

For another finite, but longer waiting-time, t w2 > t w \, 
the zero-mode discussed in Sec. Ill becomes flatter and 
one expects the amount of fluctuations to increase. If 



we also enlarge the time-window [iu^?^] to be analyzed 
in such a way that, say, the global correlation, C, re- 
mains unchanged, C{t\,t w \) — C(t 2 ,t w2 ), the new corre- 
lation length is longer than the previous one, £(£2, t w2 ) > 
£(ti,t wl ) (see the results in Sec. VA). If we keep the 
same coarse-graining linear size as before, i.e. 2M\ + 1, 
we expect the level of fluctuations in the reparametriza- 
tions to increase and the PDF p(C^ 9 (t 2 , t w2 j) to be wider 
than p(C^ 9 (ti, t w i)). If, simultaneously to increasing the 
values of the times, we also increase the coarse-graining 
volume so as (2M + 1) scales with £(t, t w ), we should be 
able to maintain the amount of fluctuations. More pre- 
cisely, the PDF computed with the new times, (£2,^2)7 
and the new coarse-graining size 2M2 + I, should be iden- 
tical to the PDF computed with (ti,t wl ) and 2Mi + 1. 

This procedure can be taken further to postulate that a 
scaling limit in which a stable distribution of fluctuations 
is reached. This limit is such that the waiting-time and 
the subsequent time go to infinity together keeping the 
global correlation fixed to a prescribed value C (note that 
this double limit can be more general than the case in 
which t w and t are proportional) , and the coarse-graining 
volume diverges together with the correlation length be- 
tween t and t w , i.e. £(t,t w )/M is held fixed. If in this 
limit the distribution of local two-time functions remains 
non-trivial, then dynamical heterogeneous regions of all 
sizes exist. 

Even though for a system with an asymptotic 
reparametrization invariant action the correlation length 
is expected to diverge asymptotically, in Sec. VA we 
showed that £(i, t w ) is still very short for the times acces- 
sible numerically in the spin-glass model that we study 
here. Thus, one cannot study the dynamics using a 
coarse-graining volume such that a <C 2M + 1 <C S,(t, t w ) 
(with a the lattice spacing). 

Another different, but also interesting, regime in which 
to study fluctuations is the following. Let us take t w and 
t very long but finite leading to a finite correlation length 
£(i, t w ). If one takes the coarse-graining linear size to be 
of order 2M + 1 ~ £(i, t w ) each block leading to a point 
in the construction of the PDFs is, roughly speaking, an 
independent model with finite size L = £(t,t w ). The 
results in Sec. VIII A suggest that the fluctuations in the 
global two-time functions of finite size systems have a 
very similar behavior to the local ones discussed above. 

Finally, if we use a coarse-graining volume with linear 
size 2M +1 3> £(t,t w ), we do not expect to have any 
fluctuations and the PDFs should be delta peaks on single 
values. 

VI. SCALING OF LOCAL SUSCEPTIBILITY 

In this section we study the dynamic behavior of the 
local integrated responses. First we select the magnitude 
of the applied perturbation by studying the behavior of 
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the global susceptibility. Next we study the evolution of 
the probability distributions of coarse-grained and noise- 
averaged quantities. 

A. Choice of field strength 




X 

FIG. 34. Distribution of global staggered susceptibilities for 
small 3 EA models. The field is applied at t w = 10 4 MCs and 
held fixed subsequently. The integrated response is measured 
at t = 4 x 10 4 MCs. In the first panel we used one noise and 
10 3 field realizations; in the second panel we used one random 
field and 10 3 noise realizations. The curves correspond to 
different field strengths given in the key. L = 8, T = 0.7 
(noise averaged) and T — 0.8 (field-averaged). 

We choose the strength of the perturbing field, h, in 
such a way that (i) there are no negative global suscep- 
tibilities; (ii) there are no global susceptibilities with a 
magnitude larger than the value allowed by fdt 1/T; 
(hi) we select the range of field strengths such that linear 
response holds, i.e. we find the maximum strength for 
which the distribution is stable. The first two conditions 



yield a lower bound on h, hum, the third determines its 
maximum possible value, h MAX . 

In Fig. 34 we show the outcome of these tests. We plot 
the PDF of the global staggered susceptibilities where we 
used two different procedures to draw the histograms. 
In the first plot, we used I0 3 realizations of a random 
field, r\i — r/e^ with ej = ±1 with probability ^, and only 
one thermal noise (note that perturbed and unperturbed 
copies are evolved with the same thermal noise). We then 
draw the distribution of global values, 

1 N 

with one point per field realization, k = 1, . . . fields- In 
the second case, we used only one random field realization 
and we draw the distribution of global values, 

1 N 

x (t,t w ) = -J2lsi k (t)-s iMzi, (71) 

' 8=1 

with one point per thermal noise realization, with k = 
1, . . . , ^noises- We see that for such a small system size 
the probability distributions p(x) change quite a bit with 
the strength of the applied field (even if the average and 
variance are quite stable, see Fig. 36 below). For larger 
system sizes, L = 16, see Fig. 35, the probability distri- 
bution stabilizes for r\ > r] Mm ~ 0.2. 

The plot in Fig. 36 shows the average and the variance 
of the probability distribution for systems of size L = 8 
and L = 16 with 10 3 noise realizations, and L = 8 with 
10 3 field realizations. We confirm that ?y MIN = 0.2 and we 
see that the behavior starts being non-linear at around 

%IAX ~ 0.7. 
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FIG. 35. Distribution of the global staggered susceptibili- 
ties for a 3d EA model with linear size L — 16 at T = 0.7 using 
10 noise realizations and one perturbing field with strength 
given in the key. t w = 10 4 MCs, t = 4 x 10 4 MCs and r t = t/10 
MCs. 
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FIG. 36. Average and variance of the distribution of global 
staggered susceptibilities in the 3d EA model against the field 
strength. The parameters are as in Figs. 34 and 35. 

We see that field strengths between 0.2 and 0.7 comply 
with our criteria. In what follows we use r\ = 0.25 and 
we focus on the noise-averaged and coarse-grained defi- 
nitions of the local susceptibilities given in Eqs. (6) and 
(8) eventually averaged over many field realizations. 

B. Time-dependent distribution functions 




-2-1012 



FIG. 37. Check of t/t w scaling of the distribution of 
noise-averaged local susceptibilities with no coarse-graining, 
M = and with coarse-graining, M = 1. The ratio is 
t/t w = 2. When t w = 1.6 x 10 4 mcs we used 1200 noise 
realizations. When t w — 3.2 x 10 4 MCs we used 200 noise 
realisations. 

Here we study the evolution of the PDF of local sus- 
ceptibilities computed as in Eqs. (6) and (8). The figure 



shows that the t/t w scaling is worse for the susceptibility 
than it is for the correlations. 

C. Coarse-grained data 

In Figs. 38-40 we show the PDF of local susceptibili- 
ties coarse-grained over different volumes. These figures 
are the counterpart of Figs. 15-17 where we showed the 
coarse-grained data for the local correlations. 
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FIG. 38. Distribution of local coarse-grained staggered sus- 
ceptibilities. L — 32, T — 0.8 and r\ — 0.25. The waiting 
times are t w = 4 x 10 4 MCs, 1.6 x 10 4 MCs, and 6.4 x 10 4 
MCs. Three ratios are considered, t/t w = 2,8,32. The 
coarse-graining volume is V = 2M + 1 = 1. 
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FIG. 39. Distribution of local coarse-grained staggered sus- 
ceptibilities. Same data as in Fig. 38 with M = 1. 

In Fig. 38 2M + 1 = 1, in Fig. 39 2M + 1 = 3, and in 
Fig. 40 2M +1 = 13. The strictly local susceptibilities 
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shown in Fig. 38 are distributed almost in a discrete way, 
one sees peaks at precise values of \i that extend also 
to the the negative side of the axis. When M — 1, the 
negative suseptibilities have not yet disappeared and the 
positive tail goes also beyond Tx 9 — 1, see Fig. 39. 
Finally, when M = 6 the PDFs are much narrower with 
no support on negative values nor values that go beyond 
Tx^ 9 = 1- Note, however, that the linear size of this 
coarse-graining volume, 2M + 1 = 13, is larger than the 
maximum correlation length reached with these times, 
say £(t, t w ) ~ 5 (see Sec. V). 
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We provide numerical evidence for these statements 
by plotting the joint probability distribution of pairs 
(Ci,Txi) evaluated at a pair of times (t w , t), and its pro- 
jection on the 2c? plane C — T\- 

A. Coarse-grained two-time functions 

In Fig. 41 we plot the projection of the joint proba- 
bility distribution of coarse-grained two-time functions 
(C^ 9 , T\i 9 ) on the C — T\ plane. The data correspond 
to a system of linear size L = 64 at T — 0.8. The coarse- 
graining linear size is 2M + 1 = 3 that is of the order of 
the correlation length £(t,t w ). We study simultaneously 
three ratios of times, t/t w = 2, 8, 32, for t w = 10 4 MCs in 
all cases. The contour levels are such that they include 
66% of the weight of the joint PDF and they correspond 
to t/t w — 2,8,32 from inside to outside. Reasonably, as 
the times get more separated the values of the local corre- 
lations vary more and the region incircled by the contour 
level is wider. This plot shows that these distributions 
are very wide, as also indicated by Figs. 16 and 40 where 
we show p{Ci) and p(Xi)i independently. Even though 
the contour levels are also wide in the T\ direction, they 
tilt in the horizontal direction of C, along the curve made 
by the crosses, that corresponds to Tx(C) for this t w and 
10 values of t. 



FIG. 40. Distribution of local coarse-grained staggered sus- 
ceptibilities. Same data as in Fig. 38 with M = 6. 



VII. THE LOCAL FLUCTUATION-DISSIPATION 
RELATION 

Which of the possibilities listed in Sec. II F does the 
local fdr follow? The aim of this section is to show 
numerical evidence for the following statements: 

(i) The local coarse-grained two-time correlations and 
responses are constrained to follow the global curve x(C) : 
the dispersion along the x(C) curve is much more impor- 
tant than the dispersion perpendicular to this curve. For 
fixed t w and increasing values of t the dispersion along 
the x(C) curve increases. This is as predicted by the 
sigma-model argument of Sec. III. Equation (33) holds 
for these functions. 

(ii) The local noise-averaged correlations do not nec- 
essarily follow the global curve. Coarse-graining this 
data does not lead to concentrating the distribution of 
(Ci,Txi) pairs around the global curve. Equation (33) 
does not hold. It is hard to test numerically if Eq. (31) 
holds since there is no constraint on the location of the 
pairs in the C — T\ plane. 

(iii) The mesoscopic fluctuations (with no average over 
the noise) behave as in (i). 
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FIG. 41. Projection of the joint probability distribution 
of the coarse-grained local susceptibilities and correlations. 
L = 32, T = 0.8 and M = 1 leading to 2M + 1 ~ £(£, t w ). The 
contour levels surround 66% of the weight of the distribution 
and each of them is drawn using a different ratio between the 
two times. From inside to outside t/t w = 2, 8, 32. 

In Fig. 42 we see the effect of further coarse-graining 
the data corresponding to the same t w and t as in 
Figs. 41. In the projected plot we see how the size of the 
cloud around the T%(C) plot is reduced. The longitu- 
dinal fluctuations that correspond to fluctuations in the 
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function f\ that characterizes the local correlations are 
killed very quickly by the coarse-graining (see the the- 
oretical background for this in Sec. Ill and the related 
effect in the values of the local correlation in Sec. IV F). 
The transverse fluctuations are also reduced but in a 
weaker manner. These are related to the fluctuations in 
the local reparametrizations and, as we argued in Sees. Ill 
and IV F, they should survive in the limit of long times 
and large coarse-graining volumes. See Sec. VIII for simi- 
lar results for the joint PDFs of the global quantities com- 
puted using sytems of small size. 
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FIG. 43. The projection of the joint PDF on the C — T\ 
plane, noise averaged quantities, L = 32, t w = 1.6 x 10 4 MCs 
and t — 4.8 x 10 4 MCs. The fdt prediction is represented 
with a straight line. 



C. Effect of coarse-graining on already 
noise-averaged data 



FIG. 42. Projection of the joint probability distribu- 
tion of the coarse-grained local susceptibilities and correla- 
tions. L = 32, T = 0.8 and M = 6. Note that here 
2M + 1 > £(*,*«,). The contour levels surround 66% of the 
weight of the distribution and each of them is drawn using 
a different ratio between the two times with t/t w increasing 
from right to left. 

B. Noise-averaged two-time functions 

In Fig. 43 we show the joint probability distribution of 
the noise-averaged local correlations and susceptibilities. 
We see that the distribution is concentrated about the 
FDT line and does not bend in the direction of the non- 
trivial part of the global x(C) as the coarse-grained data 
does, see Fig. 41. This indicates that the disorder in- 
duced fluctuations are not controlled by the sigma model 
argument of Sec. III. Note that with no coarse-graining 
the Edwards- Anderson parameter fluctuates from site-to- 
site and hence the value of the correlation at which the 
sites enter the slow scale varies. This result resembles 
Fig. 3 or Fig. 4 only that the extent of the fluctuations 
in C™° is narrower than in these sketches. 

In Sec. VIII we shall observe a very similar behavior of 
the noise-averaged mesoscopic fluctuations in finite size 
SK models. 
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FIG. 44. Same as in the previous figure, the coarse- graining 
volume has with linear size M = 1. 

In Figs. 44 and 45 we test the effect of coarse-graining 
on the joint probability distribution of noise-averaged lo- 
cal correlations and susceptibilities. In Fig. 44 the linear 
size of the coarse-graining box is 2M +1 = 3 while in 
Fig. 45 it is 2M + 1 = 7. The system size is L = 32 and 
T = 0.7. We see that in all cases the distribution fol- 
lows the fdt line. Indeed, averaging over the noise kills 
all thermal fluctuations and hence do not allow for the 
fluctuations in the time-reparametrization that cause the 
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bending of the data along the x{C) curve. This is con- 
sistent with the results in Fig. 22 where we checked the 
effect of coarse-graining the already noise-averaged local 
correlations. 
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FIG. 45. Same as in the previous two figure, the 
coarse-graining has linear size M = 3. 

VIII. FINITE SIZE SYSTEMS 

A. Barrat and Berthier [69] showed that the modifica- 
tion of the fdt in a 3d EA model of finite size that is 
evolving out of equilibrium (that is to say for t and t w 
that are well below the finite equilibration time £ E q)) has 
a very similar behavior to the one found in the thermody- 
namic limit. The system will eventually equilibrate but, 
as long as one keeps the times to be shorter than i EQ , the 
global dynamics is very much the typical one of an out 
of equilibrium system. 

In this section we study the time-dependence of the 
distributions of the global correlation and susceptibility 
for finite-size samples of both fmite-d and infinite-d spin- 
glasses. We show that the "mesoscopic" fluctuations, i.e. 
the fluctuations of the global quantities due to finite size 
effects, behave very similarly to the local coarse-grained 
ones in finite d. Moreover, we test the relation between 
the fluctuations in the susceptibility and the correlation 
and we find that they are also constrained to follow the 
global parametric x{C). 

A. The 3d EA model 

In Figs. 46 and 47 we show the evolution of the distri- 
butions of the global correlation, C(t, t w ), and integrated 
response, x{t,t w ), with time t and for fixed t w , respec- 
tively. We construct the distribution functions using one 



data point for the global correlation and linear integrated 
response of the full system obtained using one noise real- 
ization. The details of the system are given in the caption 
and key. We use L — 8 so as to be able to access smaller 
values of the global correlation than is possible in larger 
size systems. This small system size also allows us to 
have pdfs that are rather wide. 




c 

FIG. 46. Evolution of the PDF of the global correlation for 
a system with linear size L — 8 at T = 0.7. The waiting-time 
is t w = 10 4 MCs and the different values of the subsequent 
time t used in each curve are given in the key. 




FIG. 47. Evolution of the PDF of the global susceptibility 
for the same system as above. r\ — 0.3. 

In Figs. 46 and 47 we display the evolution in time of 
the pdfs for the global correlation and the global susep- 
tibility of a system with L = 8. We see that the dis- 
tributions get wider as the separation between the times 
increases. In Fig. 48 we correlate the fluctuations in the 
global correlation and suseptibility. We see that, as in 
the study of the local coarse-grained quantities in a larger 
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system, the contour levels of the joint PDF are tilted in 
the direction of the global x(C) that is indicated with 
crosses. 




c 

FIG. 48. Projection of the joint probability distribution of 
the global correlations and integrated responses for a 3d EA 
model with linear size L = 8 at T — 0.7. The strength of the 
applied field is r\ — 0.25. The contour levels correspond to the 
joint PDF for the waiting-time t w = 10 4 MCs and t/t w = 4. 
One realization of the random exchanges and 10 3 thermal 
histories are used to construct the PDF. r t — i/10 MCs. The 
straight line indicates the fdt prediction and the crosses in- 
dicate the time evolution of the average x(C)- 

B. The SK model 

With the aim of giving additional support to our claim 
that noise-averaged and coarse-grained dynamic fluctu- 
ations behave differently we analysed the dynamic fluc- 
tuations in the fully connected SK model on a finite size 
lattice. 

The SK model is defined in Eq. (2), where the cou- 
plings Jij connect all sites and are chosen randomly from 
a bimodal distribution. An infinite size system under- 
goes a thermodynamic and dynamic phase transition at 
T c = 1. When N — > oo the dynamics in the low tempera- 
ture phase was solved analytically in the asymptotic limit 
of long-times (although finite with respect to the size of 
the system) [7] . The solution has a rather peculiar struc- 
ture with the relaxation taking place in a sequence of hi- 
erarchically organized correlation scales. These are inti- 
mately related to the FDR, x(C), that takes a curved form 
for values of the correlation that fall below the Edwards- 
Anderson order parameter. 

Several studies of the growth of the equilibration time 
with the size of the system, N, indicate that this in- 
creases approximately as t EQ oc e cN ' ' [70] with c a nu- 
merical constant and the exponent a(T) increasing from 



1/3 at T c to 0.5 at T = 0.4 T c (see also Ref. [71]). Even 
though these studies used a Gaussian distribution of cou- 
plings we take these results as an indication that even for 
small samples, e.g. N = 512, we have a very large time- 
window with nonequilibrium effects before equilibration 
takes place. (We chose to use N = 512 just to have the 
same number of spins as for the 3d EA with L = 8 used 
in Sec. VIII A.) 

Numerical studies have found results in agreement with 
the analytic prediction of there being a sequence of global 
correlation scales and a curve FDR out of equilibrium [72] . 
Exactly how the scaling laws and the x(C) prediction are 
modified due to finite size effects has not been carefully 
investigated. 

In this section we present results from a numerical 
simulation of the SK model with bimodal interactions 
using MC dynamics with the heat bath algorithm at 
T = 0.4 [73]. We pay special attention to the fluctua- 
tions induced by the finite size of the systems. 

1. Finite size fluctuations of global quantities 

The natural counterpart to the coarse-grained local 
correlations and responses in finite dimensional models 
is, for a fully connected model, the global quantity itself. 
The latter fluctuates if the fully-connected system has a 
finite size. 

In Fig. 49 we display the joint PDF for the global sus- 
ceptibility and global correlation. We used t w — 64 MCs 
and we evolved the systems until t = 1024 MCs. We 
constructed the distribution functions using 10 5 pairs 
(C(t,t w ),x(t,t w )) calculated as follows. First we chose 
the value of the total time t with which to calculate the 
global quantities, e.g. t — 128 MCs. For a fixed realiza- 
tion of the random exchanges we used 10 4 noise histories 
and thus obtained 10 4 points. We repeated this proce- 
dure with 10 different realizations of disorder completing 
the set of 10 5 data points. With this data we obtained 
a probability distribution. The crosses represent the av- 
erage over the 10 5 points for t = 65, 70, 128, 256, 512, 
and 1024 MCs. In Fig. 49 we show the projection on the 
C — T\ plane of: three contour levels at 95 %, 90 %, and 
82 % from the maximum of the joint PDF calculated for 
t w = 64 MCs and t = 1024 MCs [panel (a)]; one contour 
level at 90% of the maximum of the joint PDF for four 
values of the total time, t = 128, 256, 512, and 1024 MCs 
[panel (b)]. The straight represents the expected equilib- 
rium curve. 

We see that, similarly to the local coarse-grained fluc- 
tuations for the 3d EA model, the distribution follows the 
global T\{C) curve. The contour levels are inclined in 
the direction of the global curve. Thus, despite having 
very different time-scalings, these two models have very 
similar parametric joint PDF distributions. 
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FIG. 49. Projection of the joint PDF for the global suscep- 
tibility and correlations of the SK model with N = 512 and 
/3 = 2.5. The strength of the applied field is 77 = 0.25. The 
coarse-graining over time is done using r = 2 for t w = 64 MCs 
and t = 65, 70 MCs, and r t = 2, 4, 8, and 16 MCs for t = 128, 
256, 512, and 1024 MCs. The crosses indicate values averaged 
over the distribution, the straight line is the prediction from 
the fdt. In panel a) the contour levels are chosen at heights 
corresponding to 95%, 90%, and 82% of the maximum in the 
PDF for the global correlations evaluated at t w ~ 64 MCs and 
t = 1024 MCs. In panel b) the contour levels are at 90% of 
the maximum and they correspond to the pdfs calculated at 
t w = 64 MCs and t = 128, 256, 512, 1024 MCs from right to 
left. 



2. Fluctuations in the noise averaged local quantities 

In this section we follow a similar path to the one de- 
scribed in Sec. VII B for the id EA model. We simulated 
a SK model with N = 512 spins at /3 = 2.5. The waiting- 
time chosen was t w = 64 MCs. We averaged the spin- 
spin "local" self-correlation and integrated self-response 
for chosen pairs of times t, t w with t = 128, 256, 512, and 
1024 MCs over 1600 different noise realizations. With one 
realization of the random exchanges we thus obtained N 



data points. To improve the statistics we repeated this 
procedure using 150 different SK models of the same size, 
i.e. with different realizations of the coupling strengths. 
Thus, the pdfs are constructed with 76800 datapoints as 
is shown in Fig. 50 (the crosses are the averaged values) . 
The qualitative form of the distribution is very different 
from the one in Fig. 49. The orientation of the contour 
levels does not follow the Tx(C) curve but, instead, it is 
approximately parallel to the fdt straight line. 




FIG. 50. Projection of the joint PDF for the noise- averaged 
"local" susceptibilities and correlations of the SK model with 
N = 512 and (3 = 2.5. The strength of the applied field 
is r) = 0.125. The coarse- graining times r are chosen as in 
Fig. 49. The crosses indicate values averaged over the distri- 
bution, the straight line is the prediction from the fdt. In 
panel a) the contour levels are chosen at heights correspond- 
ing to 90%, 85%, 80% and they correspond to times t w — 64 
MCs and t = 1024 MCs. In panel b) the contour levels are at 
80% and they correspond to the joint PDF at t w — 64 MCs and 
t = 1024 MCs. 

These results are similar to the ones displayed in 
Sec. VII B for the joint PDF of the local noise-avareged 
correlations and integrated responses in the 3d EA model. 
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3. Effect of partial noise averaging 

Finally, we studied the effect of partial averaging over 
the noise the global two-time functions in a still smaller 
system. By this we mean that we averaged over 10 2 real- 
izations of the thermal history the global correlation and 
integrated response of each of 6 x 10 4 SK models with 
N = 128 spins. Thus, we constructed the joint PDF with 
6 x 10 4 points. The result is displayed in Fig. 51. We 
see that averaging over the noise we destroy the behavior 
in Fig. 49: the contour levels are tilted toward the direc- 
tion of the fdt line. These results approach the ones in 
Fig. 50. 
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FIG. 51. Projection of the joint PDF for the global sus- 
ceptibility and correlations of the SK model with N = 128, 
f3 = 2.5 and n — 0.1. The global two-point functions for each 
system have been averaged over 10 2 noise realizations. The 
coarse-graining times r are chosen as in Fig. 49. The crosses 
indicate values averaged over the distribution, the straight 
line is the prediction from the fdt and the contour levels are 
chosen at heights corresponding to 80%, 70% and 60% of the 
maximum in the PDF evaluated at t w = 64 MCs and t = 1024 
MCS. 

IX. GEOMETRIC PROPERTIES 

We have analyzed the local correlations and responses 
in terms of their pdfs and by looking directly at plots for 
their spatial fluctuations along a plane or line of spins. 
An alternate way to extract information about the spatial 
structure in spin glasses is through an analysis of geomet- 
ric properties, such as the fractal properties of clusters of 
spins. 

The clusters of spins that we have chosen to study 
are defined in a way that we believe makes close contact 
with possible experiments with local probes. The usual 
definition of a cluster in a spin glass is in terms of spins 
belonging to different ground states - since we have not 
calculated the ground states in our simulations, such a 



definition is clearly not available to us. The definition 
we have chosen for clusters is as follows: for a particular 
correlation C, the cluster consists of all connected spins 
with correlation Cj in the interval [C, C+dC] for a specified 
dC. This definition is used for both coarse-grained and 
noise-averaged correlators. A similar approach could be 
easily implemented to analyze experimental data on local 
noise in mesoscopic regions in supercooled liquids and 
glasses [27-30]. 
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37 



A. Fractal analysis 




C<0.4 



FIG. 52. a) Slices of C- 9 G [0.95, 1] (extended) and b) 
— 1 < Cl 9 < —0.5 (localized). The coarse- graining length is 
2M + 1 = 3. L = 64, t/t w = 2, t w — 2x 10 4 mcs, T = 0.72 T c . 
Slices of c) CT € [0.93, 1] (localized) and d) C" a < 0.4 (ex- 
tended), and L = 32 with t ro = 3.2 x 10 4 MCs, t/t w = 2, 
t = 3200 mcs, T = 0.7. 

The richness of the spatial structure is illustrated in 
Fig. 52a) and Fig. 52b) by highlighting slices of the cor- 
relation Cl 9 taking values in a chosen interval. We show 
slices with C = 0.95 and dC = 0.05 in Fig. 52a), and slices 
of negatively correlated sites in Fig. 52b). The waiting- 
time is t w — 2 x 10 4 MCs and t/t w — 2. The coarse- 
graining time is r = 10 3 MCs. Regions with negative cor- 
relation are well localized in space while the sites with 
large C^ 9 are evenly distributed throughout the sample. 
We find an essentially space-filling distribution of points 
for any choice of positive C^ 9 larger than about 0.1 and 
a localized distribution of points for C? 9 € [—1,0]. It 
should also be noted that there is a distinct spatial anti- 
correlation between the location of sites with positive and 
negative correlation. We find that the number of points 
with C < scales approximately as L 2 and that the num- 
ber of points with C > scales approximately as L 3 for 
both L = 32 and L = 64. 

When we look at the spatial structure for noise- 
averaged correlations, a different picture emerges. In 
this case, there appear to be space-filling distributions 
of points for low correlations up to about C" a ~ 
Fig. 52c) and localized regions of correlations for C" a 
close to 1 in Fig. 52d). Indeed, one might have expected 
that only sites that are essentially forced by the disor- 
der realization to take a particular configuration and do 
not decay in time (i.e. those with large values of Cf a ) 
would be likely to show a localized distribution of points. 
In the noise-averaged case, there are essentially no sites 
with negative correlations, as can be seen in Fig. 52c)- 
d) (see also Fig. 13 for the pdf of noise-averaged local 
correlations). 



We next studied the fractal dimension of clusters of 
connected spins with C C9 € [C, C + dC]. The total number 
of spins in the cluster is regarded as its "mass" , m, and 
its radius of gyration, R g , is evaluated via the definition 
R 2 = l/(2rn 2 )X)ij \ft — ^j\ 2 where r, is the position of 
spin i [74]. The fractal dimension dt of the clusters is 
defined from the scaling of the "mass" m with the radius 
of gyration R g , m cx Rg f ■ 

1. Coarse-grained correlations 

Figure 53 a) shows m against R g for the 3d EA model 
and five pairs (C, dC) corresponding to C < 0, < C < g EA , 
C ~ q E A and C > q EA (see the key). The coarse-graining 
linear size is M = 1. There is no qualitative difference 
between the five sets of data and they are consistent with 
df = 2.0±0.1. It should be noted, however, that we only 
fit over two decades in the number of spins and it would 
be desirable to have a larger dynamic range to get more 
precise results. We obtained the same results for other 
values of t w and t and for different temperatures T < T c , 
see panel b) in the same figure. The results are relatively 
independent of the value of dC, the values of dC chosen are 
such that they are big enough that they wash out some 
of the site-to-site fluctuations due to thermal noise, but 
also small enough that they do not lump very different 
values of the correlation in the same bin. The results do 
not depend that strongly on the coarse-graining volume 
until one gets to large coarse-graining volumes such as 
M = 13, for which df ~ 2 for small clusters with a cross- 
over to df ~ d at larger cluster sizes. 

In Sec. V we defined a two-time dependent correlation 
length that is of the order of 3 to 4 lattice spacings for 
the times and temperatures we have considered. Notice 
that all the clusters obtained using M = 1 have R g < 3, 
which is of the order of the correlation length £. This is 
consistent with having d/~2<rf = 3fori? g <^. 

Some recent work suggested that one class of low en- 
ergy excitations in 3d EA spin glasses have the properties 
of lattice animals [18] and hence a fractal dimension of 
2. In that study, a fractal dimension df ~ 2 was found 
for the lowest energy excitations above the ground state 
made of a connected cluster with chosen number of spins 
and a given site. The precise connection between these 
objects and the ones studied here is, however, not clear. 
However, it is intriguing that the fractal dimension ob- 
served here is identical to the one they observed. 
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FIG. 53. Number of spins (m) against radius of gyration 
(R g ) for the coarse-grained correlations in the 3d EA model. 
M = 1. Panel a) T = 0.72 T c and three pairs of C and dC. 
t w — 6.4 x 10 5 MCs and t/t w = 2. Panel b) two values of 
T, 0.56 T c (t w = 3.2 x 10 5 MCs and t/t w = 2), T = 0.72 T c 
= 6.4 x 10 5 MCs and t/t w = 2). The dotted lines corre- 
spond to df = 2. 

In d = 2 the glass transition occurs at T c = 0. 
However, the dynamics at low T and large finite times 
strongly resembles those seen in 3d. Several "glassy" 
features are observed, such as aging phenomena and a 
non-trivial relation between global correlation and re- 
sponse [69], that eventually disappear at very long times. 
In Fig. 54 we analyze the fractal dimension of a two di- 
mensional system with L = 128, M = 3, t w = 5 x 10 3 
MCs and t/t w = 16. The dotted lines indicate where the 
points would be expected to lie for df = 2, df = 1.7 



and d 



1.5. Lattice animals in two dimensions have 



df ~ 1.5 below the percolation threshold, df ~ 1.85 
at the percolation threshold, and df ~ 2 for percolat- 
ing clusters [75]. The results here are not inconsistent 
with lattice animals in 2d, but the large error bars make 
it hard to definitively establish a connection. (The er- 



rorbars are much more important than in d = 3 since we 
work with many fewer spins: 128 2 = 16384 as opposed to 
64 3 = 262144.) The ratio t/t w used in the plot is quite 
large, similar results are obtained for other (smaller or 
larger) ratios. 
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FIG. 54. Number of spins (m) against radius of gyration 
(R g ) for the coarse-grained correlations in the 2d EA model. 
t„=5x 10 3 mcs and t/t w = 16. T = 0.8. M = 1. 



2. Noise averaged correlations 

In addition to looking at the coarse-grained correla- 
tions, we also performed a fractal analysis on the noise- 
averaged correlations. Whilst there are a number of sim- 
ilarities between the data, there were also some signifi- 
cant differences. At relatively short t w and t, essentially 
all values of C appear to have df ~ 2, as can be seen in 
Fig. 55. 

However, at longer t, or t w there are two types of be- 
havior, depending on the value of the correlation. For 
correlations C less than the peak in the distribution of 
C" a , the fractal dimension is close to 2, as found in all 
other cases. However, for large values of the correlation 
(close to 1), it appears that the df ~ 2.5 for small clus- 
ters, with a crossover to df ~ 2 at larger cluster sizes. 
This is illustrated in Fig. 56. This large value of df sug- 
gests that the clusters contributing for these values of the 
correlation may be those that do not have the effect of 
domain walls passing through them many times, as they 
are the same population of spins that are localized in the 
3 dimensional plot. 
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FIG. 55. Number of spins (m) against radius of gyration 
(R g ) for the noise-averaged correlations in the 3d EA model. 



32, 



x lC 4 mcs, t = 1.28 x 10 4 mcs, T = 0.7 and 



the averaged has been done using 868 noise realizations for 
the same random exchanges. 

Note that the same phenomenology shown in Fig. 56 
was also seen at lower temperatures, T = 0.56 T c . There 
is no qualitative difference between the data at that tem- 
perature and the data shown here. 



as (note that m&(C) is the "mass" of the k th cluster at 
correlation C) 
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FIG. 57. Average cluster size m AV against the value of the 
correlation on the cluster C. dC = 0.06. The system size is 
L = 64, T = 0.72 T c , t/t w = 2 and t w = 6.4 x 10 5 MCs for the 
coarse-grained data. The noise-averaged data is for L — 32, 
T = 0.7, t w = 3.2 x 10 4 MCs and t/t w = 2. 
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FIG. 56. Number of spins (m) against radius of gyration 



(R g ) for the 3d EA model. L = 32, t„ 
T = 0.7 822 samples. 



3.2 x 10 4 , t = 48000, 



3. Average cluster sizes 

Another way to analyze the clusters defined above is 
to look at their average size for a given value of the cor- 
relation. As illustrated in Fig. 57, it is clear that the 
largest clusters are found in the vicinity of Ci > q EA for 
both the noise-averaged and coarse-grained cases. This 
average cluster size for a given correlation C is defined 
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FIG. 58. Number of clusters normalized by the size of the 
system N as a function of the correlation. Parameters are the 
same as for Fig. 57. 

We also plot the number of clusters at a given cor- 
relation, n(C), for both the noise-averaged and coarse- 
grained cases in Fig. 58. Both have relatively similar 
forms to the PDF of the correlations, however, in the 
coarse-grained case there are very few clusters at neg- 
ative C, consistent with the existence of a few localized 
clusters evident in Fig. 52. The peak in cluster sizes 
also does not coincide with the peak in n(C), suggesting 
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a characteristic state of a large number of moderately 
small clusters with only a few large clusters even when 



B. Multifractal analysis 

Another approach to investigating the spatial struc- 
ture of correlations in aging dynamics is to perform a 
multifractal scaling analysis. In a disordered system, dif- 
ferent moments of a probability distribution may scale 
in different ways as the length scale changes. A multi- 
fractal analysis seeks to determine the scaling behavior 
of each moment of the distribution. We do not find any 
multifractal behavior here, but it would be interesting to 
look for it in other glassy models or in larger simulations. 
The method used here, as in the method of fractal anal- 
ysis, is very simple to implement and could also be used 
to examine experimental data, such as that collected in 
confocal microscopy experiments. 

We follow a similar procedure to that outlined by 
Janssen [76] , and define a box probability pi such that 



Cjg(Ci) 



(73) 



where Cj is taken to be the average correlation in the 
box. Let the box size be Lb and the system size L, which 
leads to a dimensionless parameter A = Lb/L. The theta 
function in Eq. (73) is to enforce pi > and thus pi has 
an interpretation as a probability. In practice, the theta 
function is not very important, since the average corre- 
lations in the data considered here are positive in all but 
a very small proportion of the boxes, even at the small- 
est box size Lb = 2 in 3 dimensions. The distribution 
of box probabilities P(Lb) is such that when all boxes 
are included, the total probability is unity. For a given 
A there are N(X) <~ \~ d boxes, where d is the dimension 
of space. Moments of the distribution are defined via the 
relation 



{P^Lb)), 



1 



N{\) 



(74) 



and the scaling of these moments is investigated. Multi- 
fractal scaling should be valid for 



/ < L b < L < £ 



(75) 



where I is a microscopic length and £ is the correlation 
length, and we expect the moments to scale as 



{P\L b )) L ~ X d+T ^ 



(76) 



where r(q) defines a generalized dimension d(q) via 
r(q) = d(q)(q-l) for q > 1. 



1. 3d EA model 

In the 3d EA model it is found that r(2) = 3 and 
t(3) = 6, corresponding to d(2) = 3 and d(3) = 3. The 
same behavior, i.e. d(q) — 3 is observed for q = 4, 5, 
and 6. As is evident in Fig. 59, which is for data with 
L = 64, at T = 0.72 T c with t/t w = 2, 4, 16, and 64, 
there appears to be very little dependence on the ratio 
of the two times. 
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FIG. 59. Multifractal scaling of P 3 in the 3d EA model. 
The straight line is a fit to P 3 (Lb) oc A 9 , i.e. d(3) = 3. 



2. 2d EA model 

In performing a multifractal analysis of the 2d EA 
model, the same approach to the analysis was used as 
outlined for the 3d EA model. The results were similar 
to the 3d case, in that d(q) ~ d for the times available. 
In the data shown in Fig. 60, it is clear that for q = 3, 
1.9 < d(3) < 2, with perhaps a slightly lower value of 
d(q) at long waiting times. The data is from a run with 
L = 128, T = 0.8 and t w = 5000. The time ratios con- 
sidered are t/t w = 4, 8 and 16. (Note that alternative 
definitions of the box probability in 2d, such as using \d\ 
rather than a theta function can lead to d(q) ^ d. In that 
case it appears to be due to the mixing of non-equilibrium 
correlations with equilibrium correlations. There will still 
be such mixing using the definition above, but all neg- 
ative correlations are excluded, and these may cover a 
non-trivial number of boxes for small box sizes.) 
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FIG. 60. Multifractal scaling of P 2 in the 2d EA model. 
T = 0.8, i„ = 5x 10 3 MCs, L = 128, i/t„, as shown in the 
key. 



3. Summary 

The picture obtained from the above analysis is that 
the multifractal structure of aging dynamics in 2 and 
3 dimensional EA spin glasses is very similar. In both 
cases, all moments of the probability distribution of cor- 
relations appear to scale with the same generalized di- 
mension, which is equal to the dimension of space. The 
reason why this is so here is that the correlation length 
£ is small, of the order 3 to 5 lattice spacings, and there- 
fore we are not truly in the scaling regime defined in 
Eq. (75). Nonetheless, this method of examining spatial 
heterogeneities via multifractal analysis may be a useful 
tool for investigating the behavior observed in different 
glassy models and in experimental systems. 



X. CONCLUSIONS 

In this paper we showed further evidence that the 
coarse-grained two-time correlators are the ones that re- 
flect the existence of an asymptotic zero mode in the 
underlying theory. We defined a two-time correlation 
length that controls the spatial fluctuations in the coarse- 
grained local two-time correlators and we showed nu- 
merical evidence for the asymptotic divergence of this 
length in the glassy phase of the 3d EA model, as was 
to be expected from the existence of the asymptotic zero 
mode. It should be noted, though, that for the times 
reached numerically the correlation length is still very 
short. We argued that in the limit in which the coarse- 
graining linear size M is taken to diverge together with 
the correlation length the individual and joint distribu- 
tions of coarse-grained local correlations and integrated 
responses should reach a stable form. This means that 



heterogeneities of all sizes exist in the system. This is 
another consequence of the asymptotic zero mode. 

In disordered systems one can also define noise- 
averaged, as opposed to coarse-grained, fluctuating two- 
time functions. We showed numerically that the fluctu- 
ations in these quantities are not controlled by the zero 
mode and that they behave rather differently than their 
coarse-grained cousins. In slightly more technical terms, 
we claim that: 

(i) the fluctuations in the local time-reparametrization 
hi(t) [see Eq. (18)] are coupled to the thermal noise and 
hence manifest in the fluctuations of the coarse-grained 
local correlations and responses. 

(ii) the fluctuations in the external functions fi [see 
Eq. (22)], are coupled to the quenched disorder and hence 
manifest in the fluctuations of the noise-averaged local 
correlations and responses. 

Consequently, in a system with disorder the noise- 
averaged local quantities show fluctuations in fi but av- 
erage out the ones in hi. In a system without disorder 
these quantities do not fluctuate. In contrast, for any 
coarse-graining volume if the times are long-enough the 
coarse-grained local quantities keep the fluctuations in hi 
while the ones in fi are erased since an effective average 
over the random exchanges is performed. 

We related the study of the fluctuations in the local 
correlations (and susceptibilities) to the study of the evo- 
lution of random surfaces. The local two-time functions 
correspond to the "local heights" of a fluctuating random 
surface on the d dimensional substrate. We presented a 
phenomcnological effective action for the fluctuations in 
the local quantities. This allowed us to predict several 
dynamic properties of their distributions. On the other 
hand, the geometric analysis of clusters of spins that we 
introduced in Sec. IX also has a counterpart in the the- 
ory of random surfaces; it corresponds to the analysis of 
contour levels of the surfaces [77] . A complete study of 
the statistical and dynamic properties of these surfaces 
might be useful to determine the lower critical dimension 
of different glassy models. 

The analytic calculations that we use as a guideline in 
this paper where performed using the finite d spin glass 
Hamiltonian [33]. The numerical data that we present 
also correspond to this glassy problem. However, we be- 
lieve that our results are more general and should apply 
also, with a few modifications, to other glassy problems. 
In the next section we discuss several possible spin-offs 
of our results as well as a number of models in which the 
ideas here discussed can be put to test. 



XI. PERSPECTIVES 

Several questions remain open even within the study 
of the finite d EA model. In particular, we have not 
checked numerically that a scaling limit is reached by 
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taking the limit of long-times and large coarse-graining 
volumes while keeping (2M+l)/£(f, t w ) fixed. This check 
remains out of the reach of present computer simulations. 
Another independent issue that deserves further study is 
the intriguing fact that the noise-averaged local correla- 
tions are quite insensitive to temperature and its possible 
relation to the observation of memory and rejuvenation 
in spin-glass experiments. Moreover, the study of the ge- 
ometric properties of clusters can be improved and made 
more complete in several directions, e.g. by examining 
lower temperatures in the 2d case and higher tempera- 
tures in the 3d case in order to identify similarities and 
differences, etc. 

We have stated that our approach and its results, de- 
rived in this manuscript for spin models with disorder, 
can be adapted to describe the structural glass problem. 
Let us summarize what we expect in this case. 

Dynamic heterogeneities in the super-cooled liquid 
phase have been identified numerically [31,32] and exper- 
imentally [26-28] . In the case of particle (or molecular) 
interacting systems the natural and simplest two-time 
local correlation that makes contact with our approach 
is the density-density correlator defined on boxes with 
volume Vb — (2M + l) d . Having partitioned the total 
volume V in V/Vb such boxes, one then has V/Vb local 
correlators and local responses (if a perturbation coupled 
to the density is applied) with which one can construct 
the PDFs. 

In the super-cooled liquid phase we expect that the lo- 
cal correlations and integrated responses defined in boxes 
of finite size will be typically stationary (after a suffi- 
ciently long waiting-time that goes beyond the equilibra- 
tion time) but with different finite structural relaxation 
times. This is consistent with the experimental observa- 
tion that dynamic heterogeneities in supercooled liquids 
seem to have a lifetime of the order of the relaxation 
time. At high temperatures the size of the heterogeneities 
is finite and hence one should suppress the fluctuations 
by using sufficiently large coarse-graining volumes. The 
correlation length t w ), that is also stationary, should 
remain finite, even in the limit of long-times. From a the- 
oretical point of view, this picture is, in a sense, similar 
to the one that describes the paramagnetic phase in the 
O(N) model, just above the ordering transition temper- 
ature. 

When lowering the temperature the size and life-time 
of the heterogeneities increases [31]. A mean-field-like, or 
mode-coupling-likc approach predicts that their typical 
size will diverge at the mode coupling transition temper- 
ature [78]. We expect then that the correlation length 
£(t, t w ) will saturate at a higher value when T decreases 
approaching T c . In real systems the divergence at T c is 
smoothed and hence £(t,t w ) should not strictly diverge. 

At still lower temperatures the bulk quantities age and 
we expect then to observe heterogeneous aging dynamics 
of the kind described in this paper, with a two-time de- 



pendent correlation length for the local fluctuations. The 
heterogeneities will age too, in a "dynamic" way. By this 
we mean that if a region looks older than another one 
when observed on a given time-window, it can reverse its 
status and look younger than the same other region when 
observed on a different time-window. 

The numerical studies of the global two-time corre- 
lations and integrated susceptibilities of Lennard- Jones 
mixtures [53,54] have shown a remarkable accord with 
the predictions from the analytic solution to mcan-field- 
like glassy models [1,2]. We then expect that the PDFs of 
local correlations and local integrated responses, for the 
same time-scales used for the bulk calculations, will show 
the main features described in this paper. In particular, 
we expect the joint pdfs to reproduce the sketch shown 
in Fig. 3. 

In the glassy phase, we expect the correlation length of 
structural systems to grow for increasing times roughly in 
the manner here described. However, this growth might 
be modified for long enough times when the dynamics 
crosses over to a different, activated-like, nonequilibrium 
regime that we cannot characterize theoretically [1,87]. 
We cannot predict what happens to the correlation length 
on these extremely long time-scales. 

The ideas discussed in this paper should not only ap- 
ply to systems that relax in a nonequilibrium manner as 
glasses but also to systems that are kept out of equi- 
librium with a (weak) external forcing. As shown in 
Ref. [79] the time-reparametrization of the bulk quan- 
tities that is selected dynamically is very easy to modify 
with external perturbations. Indeed, a small force that 
does not derive from a potential and is applied on every 
spin in the model renders an aging p spin model station- 
ary [80] while the model maintains a separation of time- 
scales in which the fast scale follows the temperature of 
the bath, T, while the slow scale is controlled by an an 
effective temperature, T EFF > T. In this case, the aging 
system selects a time-reparametrization h(t) = t [9,56] 
while in the perturbed model h(t) = e~ t ' Ta . Similarly, 
the aging of a Lennard-Jones mixture is stopped by a 
homogeneous shear [54]. A different way to modify the 
time-reparametrization that characterizes the decay of 
the correlations is by using complex thermal baths [79]. 
Recently, there has been much interest in the appearance 
of shear localization, in the form of shear bands, in the 
rheology of complex fluids [81,82]. Along the lines here 
described it would be very interesting to analyze the fluc- 
tuations in the local reparametrizations in the fluidized 
shear band and the "jammed" glassy band. 

The appearance of an asymptotic invariance under 
time-reparatrizations in the mean-field dynamic equa- 
tions was related to the reparametrization invariance of 
the replica treatment of the statics of the same mod- 
els [6,83]. The latter remains rather abstract. Recently, 
Brezin and de Dominicis [83] studied the consequences of 
twisting the reparametrizations in the replica approach. 
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Interestingly enough, this can be simply done in a dy- 
namic treatment either by applying shear forces, as dis- 
cussed in the previous paragraph or by applying different 
heat-baths to different parts of the system. More pre- 
cisely, using a model with open boundary conditions one 
could apply a thermal bath with a characteristic time- 
scale on one end and a different thermal bath with a dif- 
ferent characteristic time-scale on the opposite end and 
see how a time-reparametrization "flow" establishes in 
the model. 

We would like to end this article by mentioning a num- 
ber of other tests and interesting applications of the ideas 
here described to other models with a slow relaxation. 

(i) In this paper we studied the distributions of the 
two-time, local in space, spin-spin correlations and their 
associated responses. In a finite dimensional system one 
can construct many other two-time correlations that are 
still local in space. The question then arises as to if all 
the distributions of all possible correlators have the same 
qualitative features. 

(ii) An important property of the interpretation of the 
FDR in terms of effective temperatures is that in systems 
that reach an asymptotic regime with slow dynamics and 
small entropy production one expects that all observ- 
ables evolving in the same time-scale partially equilibrate 
and hence have the same value of the effective temper- 
ature [59]. Related to this question one can try to de- 
termine if the joint probability distributions of the local 
correlations and susceptibilities of other pairs of observ- 
ables are the same and have the same time evolution. 

(iii) We expect to see a similar behavior of the local 
FDR in simple systems undergoing domain growth [44]. 
More precisely, using the coarse-grained local correlations 
between the fluctuations in the magnetizations and their 
associated coarse-grained local susceptibilities, we expect 
to find a joint PDF that is mostly concentrated along a 
flat, global x(C) curve when d > 1. This statement can 
be checked rather easily with Monte Carlo simulations of 
the finite dimensional ferromagnetic Ising model. 

(iv) Related to (iii), the ferromagnetic Ising chain is a 
particularly interesting case of study. It has been proven 
that at zero temperature (or when the coupling strength 
diverges) the global fdr takes a curved form x(C) [84]. 
For this model it might be possible to derive an analytic 
expression for the joint PDF. Similarly, one can attempt 
an analytic calculation at criticality in coarsening models 
as done in Ref. [85]. 

(v) Kinetically constrained lattice models [42] capture 
many of the characteristic features of glasses. An ana- 
lytical study of dynamic heterogeneities in one such spin 
model has recently appeared [43] . Versions in which one 
works with particles on a lattice are also rather sim- 
ple to simulate. In these models one can partition the 
full lattice in boxes of size (2M + l) d and define the lo- 
cal two-time density-density correlators within them. A 
local susceptibility can also be easily defined following 



Ref. [86]. A check of the form of the joint probability 
distribution and its evolution in time is an interesting 
problem. 

(vi) One would like to study realistic models of glass 
formers with molecular dynamics and test the scaling 
laws and qualitative features in these cases. 

(vii) Herisson and Ocio [58] studied recently the bulk 
two-time correlation between magnetic fluctuations and 
the bulk two-time integrated response to an external 
magnetic field (magnetic susceptibility) of an insulator 
spin-glass. Their aim was to test the modifications of 
the global fdt in this nonequilibrium system. In or- 
der to have smooth data, they averaged these quanti- 
ties over many repetitions of the experiment done af- 
ter heating the sample above the transition. In our 
terms, the bulk correlations were averaged over differ- 
ent noise-realizations. Another experimental system in 
which the two-time evolution of a bulk two-time corre- 
lation has been recorded, in this case the voltage noise 
self-correlation, is laponite [30]. Large fluctuations ap- 
pear. It will be very interesting to analyze the pdfs of 
the two-time noise-noise correlation and th e two-times 
integrated response along the lines here described. 

Last, but not least, the approach based on 
reparametrization invariance suggests that it may be pos- 
sible to search for universality in glassincss. For example, 
a Ginzburg-Landau theory for phase transitions captures 
universal properties that are independent of the details 
of the material. It is symmetry that defines the uni- 
versality classes. For example, one requires rotational 
invariance of the Ginzburg-Landau action when describ- 
ing ferromagnets. Reparametrization invariance may be 
the underlying symmetry that must be satisfied by the 
Ginzburg-Landau action of all glasses. What would de- 
termine if a system is glassy or not? We are tempted 
to say the answer is if the symmetry is generated or 
not at long times. Knowing how to describe the uni- 
versal behavior may tell us all the common properties 
of all glasses, but surely it will not allow us to make 
non-universal predictions, such as what is the glass tran- 
sition temperature for a certain material, or whether the 
material displays glassy behavior at all. This quest for 
universality is a very interesting theoretical scenario that 
needs to be confronted. 
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